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I. INTRODUCTION : •GOLLECTING MATERIAL 

The scale is intended fo'mfeasore. three general phases of 
free-hand drawing: Represeritafipn/ Resign and Composi- 
tion and Color. The themes of each phage from which 
sample drawings were made were chosen Svith a view of 
exemplifying the primary principles of drawing. In vskt^ 
the scale, the attention of both teacher and pupil is directed 
to the elements of drawing as revealed by the samples in 
steps of achievement on the scale, and to the more or less 
analytic descriptions given under each sample. Obviously, 
then, the scale is essentially analytic in both construction 
and function. The purpose is to measure drawing as done 
in public elementary and high schools, to measure the pupils' 
progress in that subject year by year or grade by grade. 
The numerical values of the scale units represent values 
above a sample rated as zero. The relation of grade achieve^ 
ment to these values will be determined as the scale is stand- 
ardized. 

I. From. Primary, Grammar and High School Grades 

As a rule, the use to which the sample drawings were to 
be put was explained to the supervisor of drawing in a 
personal interview. Circular letters describing the purpose 
of the work, listing the themes for the drawings, and giving 
details of the conditions under which they were to be pre- 
pared were given to the supervisor who distributed them 
among teachers of drawing. These letters were of three 
slightly different sorts, depending on whether they were to 
be used by teachers of lower school grades (first, second, 
third, and fourth) or by teachers of higher elementary 
grades (fifth, sixth, seventh and eighth), or by high school 
teachers. They were sent out in October and November, 
1919, under the auspices of the Department of Education of 



2 introduction: collecting material 

The Johns Hopkins University. Sample copies of the letters 
are here given. 

To Teachers of Drawing in the Lower Elementary School Grades: 

The drawings asked for below are to be used in the construction 
of a measuring scale for estimating.* ^}ie pupil's rate of progress in 
drawing. •.* .' 

Three phases of drawing qre:to be d6nie : ' Representation/ * Design 
and Composition/ and * ColrJH.' : The 'themes from which the drawings 
are to be made are nin'n^ryi'i four in * Representation/ four in ' De- 
sign and Compc>sition* and Tour in ' Color.' 

*. •.'.•' Part I. Representation 
. • » * 

.• :*t!.^r,aw a house. 2. Draw a rabbit. 3. Draw a figure in action 

■ . '(6oy funning) . 4. Make a brush drawing of a tree. 

:\ ' Part II. Design and Composition 

1. Illustrate a story. Any story which the teacher may select such 
as The Pied Piper blowing his horn with children or rats following, 
The Three Bears, Cinderella, one of Aesop's fables, Aladdin and the 
Wonderful Lamp, etc^ will be acceptable for this exercise. It may 
be done with colored crayons or scissors and paper. 

2. Make a border approximately 2" x 6". A tree, a rabbit or other 
animal, a boat or a house are suggested as units, but any form with 
which the children are very familiar may be used. It may be done 
with paper and scissors or with crayons. In the kindergarten and 
Grade I it may be connected units secured through manner of folding 
the paper, such as paper dolls taking hold of hands, boats, trees, etc. 

3. Make a poster advertising a school activity. In the kindergarten 
and Grade I, if children are unable to form words, they may make the 
poster omitting the lettering. The work will and should be crude 
but it should represent the child's expression of some event within his 
experience. It may be the announcement of a game, entertainment, 
or other school activity, a garden poster, or a poster to stimulate 
thrift, but should, above all, have the child's interest. 

4. Draw or cut out of paper a pattern for a bowl or other utensil 
which you would like to model out of clay. Draw upon it a simple 
decoration which you think will make it more attractive. This is not 
to be a drawing in perspective. Make top and bottom lines straigiit. 

Part III. Color 

1. Draw from memory the United States flag on 9" x 12" draw- 
ing paper. Use colored crayons and make the colors as near like the 
real flag as possible. 

2. Paint a flower in color. Use brush and water colors if you have 
them. If not, draw the flower with colored crayons. This is to be 
done from memory. (Choose a flower having a decided color — a 
single flower preferred.) 

3. Make a color circle or wheel showing the six standard colors 
and write the first letter of each color above the circle. 

4. Make a border approximately 2" x 6" using complementary colors. 
If available, use colored papers. If not. use colored crayons. 

Note. — Kindergarten teachers may do the first two only. 
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Please have all pupils make from memory one drawing each of 
Numbers i, 2» 3 and 4, in each of the three phases indicated above. 

Have the pupil write on the back of the drawing paper his age and 
number of the school grade, but nothing more, ^fo writing of any 
kind should appear on the page with the drawing. The teacher in 
charge will record on the bade of the drawing the approximate time 
in minutes required to make it. 

As far as possible, have the drawings made under class room con- 
ditions. 

It is assumed that the drawing paper and other materials will be 
uniform in quality for all the pupils. 

The pupil should understand clearly what is to be drawn, but 
no instruction should be given as to how it should be done. 

(It is understood that pupils of the kindergarten and of the first 
grade will attempt only those themes which they understand and of 
which they have memories, e.g., a house, a boy rtmning, etc.) 

To Teachers of Drawing in the Higher Elementary School Grades: 

The drawings asked for below are to be used in the construction of 
a measuring scale for estimating the pupil's rate of progress in 
drawing. 

Three phases of drawing are to be done : ' Representation,' ' Design 
and Composition ' and ' Color.' The themes from which the drawings 
are to be made are numbered ; four in * Representation,' four in 
' Design and Composition ' and four in ' Color.' 

Pakt I. Representation 

I. Draw a house. 2. Draw a rabbit. 3. Draw a figure in action 
(boy running). 4. Make a brush drawing of a tree. 

Part II. Design and Composition 

1. Illustrate a story in such a way as to show the use of the prin- 
dple of subordination. Any well-known story from literature or 
history may be chosen. Such subjects as "The Pied Piper of 
Hamelin/' 'Hannibal Crossing the Alps," "Jason and the Golden 
Fleece," " Story of the Wooden Horse," " The Boston Tea Party," 
"The Courtship of Miles Standish," etc., furnish material from the 
Qther subjects in the curriculum. 

2. Make a 2" x 6" border, illustrating the principles of repetition and 
rhythm, using any unit with which the children are familiar. 

3. Make a poster advertising a school activity, composed of lettering 
and an illustration. Choose something simple which they know how 
to draw well, and combine it with as little lettering as possible to make 
it forceful. 

(The above problems may be done with colored crayons, with scis- 
sors and paper, with drawing pencils, or with charcoal, but the draw- 
ings will be judged on the merits of Design and Composition only.) 

4. Draw or cut out of paper a pattern for a bowl, vase, or other 
utensil which might be moddled out of clay. Draw upon it a simple 
decoration which will make it more attractive. 

(This is not to be a drawing in perspective. Make lines representing 
the top and the bottom of the dish horizontal.) 
(Use paper 9" x 12".) 
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To insure that all pufnls work under uniform conditions, it is advised 
that the following principles of composition be explained to the class 
before beginning the exercise : 

1. Subordination means the organization of elements about a center 
of interest and the elimination of unimportant details. The use of this 
principle brings order out of confusion, and gives unity to a design 
or composition. 

2. Repetition in a design or composition means the use of the same 
element or elements again and again. The intervals may be equal, 
as in a repeating pattern or border, or unequal, as in a landscape. 

3. When the spacing is done in an interesting way it produces 
rhythm. 

Part III. Color 

1. Make a color wheel showing twelve colors, including the six 
standard colors and six intermediate colors. Use water colors if pos- 
sible. If not, available, use colored crayons. (These colors can be 
only approximately correct, but the exercise will test the pupil's ability 
to discriminate in the use of color.) 

2. Make a poster using a color triad with black, or white, or both. 
Use colored papers, water colors, or crayons. 

3. Make a decorative landscape, using three values of one hue and a 
complementary hue. 

4. Make a border approximately 2" x 6", using two values of one 
color and its complement. The background will represent one of the 
values or one color, as desired. Use colored papers, crayons, or water 
colors. 

To Teachers of Drawing in the High School (Grades p, 10, 11 and 12) : 

(The instructions here are similar to those given above.) 
The material for the several exercises follows : 

Part I. Representation 

I. Draw a house. 2. Draw a rabbit. 3. Draw a figure in action 
(boy running). 4. Make a brush drawing of a tree. 

Part II. Design and Composition 

1. Illustrate a stonr in such a way as to show the principle of sub- 
ordination. Any well-known story from literature or history may be 
chosen. Use pencil, charcoal, or any medium desired, but the draw- 
ings will be rated upon the composition only. 

2. Make a 2" x 6" border illustrating the principles of repetition and 
rhythm. Any medium may be used, but proportion or good spacing 
will determine the success of the exercise. 

3. Make a poster advertising a school activity. It ma^ be done in 
any medium, but the exercise will be judged on composition and de- 
sign only. Technique of drawing or color will not enter into the rating 
of these posters. Use as little lettering as possible, and for the illustra- 
tion choose something you can draw well. 

4. Make a design for a sideboard showing front and end views. 
Proportion and spacing will be considered in judging this exercise. 
This is not an exercise in perspective. Do not try to show the top. 

The above problems may be done with colored crayons, or scissors 
and paper, or with drawing pencils, but the drawing will be judged on 
the merits of design and composition only. Before beginning the 
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exerdses, be sure that you understand the meaning of the principles 
involved. The following definitions will assist in Uiis. They may be 
elaborated upon by the teacher in any way she may desire. 

(Definitions of subordination, repetition and rhythm were included 
as above.) 

Part III. Color 

1. Make a poster using a color triad with gray, black, or white. 
The poster may be made of colored papers or show card colors. 

2. Make a decorative landscape using three values of one hue and a 
complementary hue. 

3. Make a 2" x 6" border showing an analogous harmony. 

4. Make two scales, one showing six values of one color, and the 
other six intensities of the same color. 

It will be observed that the circular letters required: (i) 
that the drawings be made under class room conditions as 
nearly as possible ; (2) that they be made from memory and 
without instruction on the themes immediately preceding or 
during the drawing exercise; (3) that the time spent in 
making the drawings (passing and collecting material not 
included) , the age and grade of the pupil, be stated on the 
back of the drawing. The teacher of art, as well as the gen- 
eral reader, is again reminded that the drawings were done 
from memory and without coaching for the particular exer- 
cise in question. 

2. Material Collected and Catalogued 

The first returns were received in December, 1919, from 
the city public schools of Baltimore. From that date until 
June, 1920, drawings were received from the city public 
schools of Washington, D. C, Duluth, Minn., Virginia, Minn, 
and from Oshkosh, Wis. Over 600 came from two private 
schools in Baltimore. The number of drawings on the 19 
themes in this preliminary collection totalled over 14,000. We 
are concerned in this report. Part I, with the drawings of the 
first four themes, drawings that involve the technique of 
representation only. The number by grades and by themes 
are shown in Table I. While this number is perhaps suf- 
ficient, our experience is to the eifect that both quality and 
variety of the samples would have been more satisfactory 
had they been gathered from a larger number of localities. 
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This defect, if it be one, will be corrected in collecting 
further samples for the remainder of the scale on ( i ) design 
and composition and (2) color. 



TABLE I 
Showing Distribution of Drawings by Grades and by Themes 

Grades 

, A 

Themct Kdgn I II III IV V VI VII VIII IX X XI XII Tota 

I. Houae 90 aoo 204 130 151 136 11 1 laS 90 130 84 33 1487 

a. Rabbit 71 137 171 113 88 66 73 109 56 90 22 20 6 toaa 

3. Figure in action 10 131 179 109 69 120 112 100 66 55 45 36 103a 

4. Bruah drawing of tree 66 173 a86 17S i7S 178 17S x8o laa 51 44 48 1673 

ToUla a37 641 840 327 483 5oo 471 517 334 3^6 19S ^37 6=5314 

In the matter of constructing a scale by using a series of 
drawings of the same theme, Professor Thomdike says in 
his pioneer drawing scale that 

If we had in the scale a series of drawings of flowers of merit, 2.4, 
3-9» 57» 6.5, 7.8, 8.6. 10.5, etc., a series of drawings of horses of merit, 
24i 3.9, 5.7, 6.5, 7.8, 8.6, 10.5, etc., a series of designs for book-covers 
of merit, 24, 3.9, 5.7, 6.5, 7.8, 8.5, 10.5, etc., .... the scale would 
obviously be more useful to measure the merit of drawings of horses, 
book-covers, and flowers .... than it now is. 

Teachers of drawing will readily understand the reasons 
for selecting these four themes : house, rabbit, figure in action, 
brush drawing of tree, for a scale in * representation,' but 
that their purpose may be apparent to everyone some further 
comment is necessary. 

Drawing merely to represent objects is not regarded as an 
end in itself ; it is intended, rather, to accompany the work 
in design and composition and color. The use and treatment 
of a theme in representation in the teaching of art, then, 
depends upon the frequency and readiness with which it 
serves the ends of design and composition. The four themes 
in question were chosen largely upon that principle and 
are intended to be thus used by teachers of drawing. They 
afford suitable exercises for the acquisition of the more ele- 
mentary forms of technique and for drill work that is so 
essential in acquiring a drawing " vocabulary." Drawing a 
house trains in the art of expressing forms and construction 
by the use of perspective; drawing a rabbit affords an exer- 
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CISC for expressing action, growth and texture ; drawing the 
human figure in action develops the art of expressing motion, 
action, growth and texture in living forms. The brush draw- 
ing of a tree, owing to the nature of the drawing material 
used and to the comparatively exacting technique, presents 
a number of new problems. Spreading color for artistic 
effects by means of a brush requires during the operation 
all the attention at the pupil's command. And for that rea- 
son, the factors of form, proportion, growth, lexture, and 
light and dark must be duly considered before applying the 
brush. It is planned to present design and composition and 
color in Parts II and III, respectively, of the scale. 

The drawings were catalogued by school grades, each 
grade being indicated by a capital letter. Each sample in 
a grade was given a serial number, and the themes were 
shown by digits placed as exponents on the sample's serial 
nimiber, e. g., B3' signified sample Number 3 of First grade 
drawing, and, if in representation, the theme, rabbit. Then 
by indexing the books in which the drawings were listed, it 
was possible to locate a sample at an instant's notice. 



II. METHODS FOR GROUPING THE SAMPLES 

I. Status of the Judges 

Ninety-two judges were engaged on this portion of the 
work — Part I. Of this number twenty-eight, or 30^^, were 
teachers of art or supervisors of art in city public schools ; 
forty-nine, or 54^, were teachers of academic subjects in 
public schools and colleges. Nine, or 19^, were art students, 
and (^ were educated laymen. 

2. Step i : Distribution of Samples Without and 

With Aid of Legend 

A new scale in any of the common branches must hence- 
forth justify its existence by functioning in the school room. 
Obviously, a scale for free-hand drawing must fulfill that 
requirement, must be of a sort that both pupils and teachers 
can readily use and be appreciably benefited by such use. 
This principle has controlled all matters bearing on the con- 
struction of the present scale and especially on the methods 
for selecting and scoring the samples. 

It was early decided, as already observed, that the scale 
should be analytic, that the differences between the samples 
forming the scale should consist of differences in degrees of 
mastery of evident principles of drawing, that steps, so- 
called, in the scale should embody principles susceptible of 
simple description and at the same time exhibiting the prob- 
able order in which they are achieved by the learner. 

The plan, here finally adopted, had its beginning in 191 1, 
when one of the authors found it necessary to devise a 
method by which to score some 225 drawings. The material 
consisted of free-hand drawings of a rooster, made under 
three different conditions. The large number of specimens 
made the usual methods of rating, e. g., serial and alternate, 
impractical. An inspection of the drawings showed a wide 
range of achievements ; some were so poorly done that the 

8 
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intentions of the author were not revealed, other groups con- 
tained samples that represented a bird but left the species 
in doubt. Still other drawings represented a domestic fowl 
other than a chicken, etc. Working over the drawings in this 
fashion resulted in the formulation of a set of * checks ' by 
which the rating was eventually done. The ' checks/ with 
their arbitrary values follow : 

I 
A drawing that docs not show the author's intention is rated o 

2 

A drawing that represents a bird but leaves the spedes in doubt is 
rated i 

3 

A drawing that represents a domestic fowl other than a chicken, 
as turkey, guinea hen, etc, is rated 2 

4 

A drawing diat represents a hen or leaves the sex in doubt is 
rated 3 

5 

A drawing that represents a rooster, but is lacking in artistic 
form (wooden), is rated 4 

6 

A drawing that expresses fair proportions and qualities of life 
is rated 5-6 

7 

A drawing that shows skill in the use of line to express qualities 
of life and good form is rated 7-8 

8 

A drawing that shows good arrangement and skill in the use of 
line to express life and form is rated 9-10 

The value of such a crude set of ' checks ' or legend is 
limited to the drawings of a special object; and, besides, 
only a few of the checks embody principles of art. The 
control that it afforded the judges, however, in rating the 
samples fully justified its use and suggested, at the time, 
the desirability of formulating a legend that would be uni- 
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versal in its application, and that would embody the essential 
principles of art knowledge. The sugestion was acted upon 
(Gertrude L. Carey) and resulted in the formulation of 
three legends: one for scoring drawings in representation, 
one for design and composition, and one for color. They 
embody the primary principles of the three phases of draw- 
ing arranged on a probable genetic and development basis, 
or roughly, in the order in which they are acquired by the 
pupil. Only the legend on representation is given in this 
report. Its present form is the result of several revisions 
made in the light of years of experience in teaching and in 
directing art education in city public schools. 

A. WITH AID OF UNWEIGHTED LEGEND 
(Sixteen Judges Were Asked to Make the Preliminary Distribution) 

Two of the judges were art supervisors, one an art 
teacher, two were art students, one an art connoisseur, and 
ten were regular teachers of academic subjects. The numeri- 
cal values assigned to the principles grew apace with rough 
and tentative distributions of the drawings. When guided 
by the legend (unweighted), the judges experienced but 
slight difficulty in distributing a thousand or more samples 
into seven piles, and had considerable confidence with the 
majority of the classifications. Of course, they were often 
confronted with samples showing one or more drawing prin- 
ciples applied with some excellence, but markedly deficient 
in some other ; and likewise, samples appeared on the border- 
land between two sets of consecutive principles. 

These rough distributions piled the drawings from any 
school year high at the simpler end of the legend and thinned 
them out at the approach of the difficult end. The draw- 
ings in the large piles answering to the simpler principles 
showed wide differences in quality, while those of the better 
types, embodying higher principles of the legend, increased 
in similarity, and as a consequence, grades of difference grew 
markedly less. The drawings of the four themes followed 
the same principle. 
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B. WITHOUT AID OF LEGEND 

It seemed desirable at this point to distribute the draw- 
ings, without the aid of the legend, into as many groups as 
qualitative differences could be discriminated. Four judges 
worked under these conditions. Two were graduate stu- 
dents in The Johns Hopkins University. One of these, who 
had formerly supervised drawing in the public schools, made 
14 groups out of the houses — 1487 drawings. The second 
student, who had taken general art courses distributed the 
rabbits — 878, into 16 groups. A third judge, employed in 
an art store, an art connoisseur, distributed the * figure in 
action ' into 16 groups. The fourth judge, the writer, having 
a more intimate knowledge of the legend, was doubtless in- 
fluenced thereby, made 18 groups of the rabbits, now to the 
number of 1022. The judges uniformly claimed that the 
capacity for discrimination improved decidedly with prac- 
tice and believed that further practice would have increased 
the number of groups. These two lines of experience, 
(i) distributing the drawings under the control of the 
legend unweighted, and (2) distributing them without such 
control, and, in addition, the large number of samples to be 
handled, suggested that methods be devised whereby thou- 
sands of unsuitable drawings for scale making could be 
eliminated under control, and a few dozen fit samples be 
retained. 

3. Step 2: Distribution of Samples With Weighted 

Legend for Purposes of Eliminating and 

Selecting Drawings 

The preliminary work thus far suggested that rejecting 
and retaining samples could be accomplished by applying, 
throughout the distribution, the question : " Does the sample 
possess or lack this or that principle of the legend ? " While 
this method made it possible to distribute the drawings under 
control into seven groups, it made no provision for rating the 
drawings within a group, drawings that showed wide varia- 
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tions of skill in handling the same principle or set of prin- 
ciples. 

Observations on the progress of pupils' drawings from 
year to year (Gertrude L. Carey) has shown that more steps 
of marked improvement occur, as a rule, in the earlier years, 
and that the increments of improvement in the use of a 
given principle diminish gradually as maximum skill is 
attained. The same principle, of course, operates in the. 
acquisition of any skillful art. For these reasons, it was 
decided to attach unequal weights to the drawing principles, 
weights of wide range at the lower end, and g^dually nar- 
rowing toward the other. Henceforth, these numerical 
weights are referred to as Group Scores. There are six, not 
including the zero group. The fact that from 14 to 18 steps 
could be discriminated in these drawings and that the scoring 

• 

process improved with practice, suggested that at least 20 
steps of equal intervals should be provided and duly appor- 
tioned to the score groups. The number of equal steps 
(class intervals) assigned to a group score was based upon 
the number of differences sufficiently marked and character- 
istic, so as to permit description in untechnical language. ^ 
By this method it was discovered that six steps could be 
made out in group score 2, the one above zero, that five 
steps existed in group score 3, and four steps in group score 4, 
and two each in group scores 5 and 6, respectively, and one 
step in group score 7. 

The steps within a score group were raised to five units 
(the width of step or class interval) to avoid the suggestion 
of scoring to a mere point, and, besides, it expanded the 
range of the score groups from o to 100, which will likely 
prove convenient in the matter of standardization. Subse- 
quent rating of samples showed, however, that they were 
rarely scored above the interval of 91-95, and thus the range 
from o to 100 proved entirely adequate for distributing the 
qualities of drawings now done in the public schools. The 
l^end in its final form appears on page 14. 
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Drawings of the zero type marked the starting point. 
To determine the next sample for the next step in the scale, 
the more usual method calls for one which 75% of the 
judges consider just better than zero ; a third sample is one 
having the same percentage of agreement that it is just better 
than the second sample; and the fourth, fifth, etc., samples 
of the corresponding steps of the scale are similarly arrived 
, at. We rejected this method for these reasons: (i) The 
desirability of sectiring a scale in terms of special values 
ranging from o to 100. (2) A drawing scale to function 
must embody principles and technique of drawing arranged 
on a progressive plan. Principles expressed in the samples 
of the scale must be chosen just as they are combined and 
applied by the pupil under conditions of learning; and the 
difference between successive steps should be sufficiently 
concrete so as to be recognized by the pupil, especially when 
described in simple language. 

A sample, to be just better than zero in the present study, 
must have meaning as conditioned by the theme, but it must 
not possess principles of art as such. According to the 
legend, the sample must be " deficient in the elements of 
proportion, etc." The term ' deficient,' rather than * lacking,' 
was preferred on the grounds that a drawing entirely void of 
proportion, etc., would also lack meaning. The legend pro- 
vided for six degrees of meaning, for the reasons assigned 
above. A sample, to be placed just beyond the mere " mean- 
ing " group, must express an intentional use of an elemental 
art principle, e. g., proportion, balance, structure. Here five 
steps were formed. The principle governing the formation 
of the rest of the score groups may be made out from the 
legend. 
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Legend for Scoring Drawings in Representation 



Distinguishing principles 
of the groups 



Group 
score 



Score 
intervals 



A drawing that fails to express the intentional 
meaning of the pupil may be rated 



A drawing that expresses the intentional mean- 
ing of the pupil, but is deficient in the ele- 
ments of proportion, structure, and action, 
may be scored from i 



to 30 



I- 5 
6-10 

ii-iS 
16-20 

21-25 
26-30 



A drawing that expresses action and the ele- 
ments of proportion and structure may be 
scored from 31 to 55 



31-35 
36-40 

41-45 
46-50 

51-55 



A drawing that expresses action and the ele- 
ments of proportion, structure, relation of 
parts and perspective, but has a minimum of 
artistic qualities, such as growth, texture, 
and structure in living and constructed 
forms, may be scored from 56 to 75 



56^ 
61-65 
66-70 

71-75 



A drawing that expresses proportion, a knowl- 
edge of the fundamental principles of per- 
spective, action in living forms, and some 
skill in the use of line and dark and light to 
show growth, texture and structure, may be 
rated from 76 to 85 



76-80 
81-85 



A drawing that shows proportion, a knowledge 
of perspective, of structural features, and of 
action and a more skillful use of line and 
dark and light to show growth, texture and 
structure in living and constructed forms, 
may be rated from 86 to 95 



91-95 



A drawing that shows correct proportions and 
an understanding of the principles of per- 
spective, of structural features and action, 
and considerable skill and feeling in the use 
of line and dark and light to show growth 
and texture may be rated from 96 to 100 



^'bcsesdE ill 

;;::■"■ ■ » ■ 


H 



us 



■s.|x; 



METHODS FOR GROUPING THE SAMPLES IS 

A copy of the directions for using the legend and for 
scoring the drawings was placed in the hands of the judges. 
The directions follow here. 

Directions to the Judges for Scoring the Drawings 

You are asked to score in numerical terms drawings made to repre- 
sent objects. 

I 

Read carefully the legend prepared to assist you in rating the 
drawings. It contains the primary principles of. drawing arranged 
in the order in which they are usually mastered. You will note that 
the drawings may fall roughly into seven groups according as they 
possess, or lack, tnese principles, and into twenty-one groups according 
to the degree of skill shown in applying the principles. 

II 

To score a sample: 

1. Observe what principles it embodies, e. g., look for (a) inten- 
tional meaning; (b) proportion and symmetry in parts, between 
parts, as a whole; (3) elements of perspective, growth, texture, and 
structure in living or in constructed forms, as shown by light and 
dark, and by line, etc. 

2. Observe the degree of skill with which the principles have been 
handled. 

3. From (i) and (2) determine the numerical score of the sample. 
Then place the drawing or sample on the score- table by the label 
bearing its score. 

Ill 

Labels have been provided for scores ranging from o to 100. If 
this range proves inadequate, make additional piles beyond the 96-100 
limit: notice that each of the 20 intervals above o are divided into 
points. Make as many trials as you like until you are satisfied with 
the score assigned the specimen. Select a * type ' drawing for every 
pile that you make which expresses the principles of that score. Place 
the 'type' conspicuously by the side of its assigned score (label) so 
that it may aid in scoring other drawings. 

IV 

After having scored and placed all the drawings of a theme into 
the several score piles, arrange each pile, including its type, in a 
serial order, beginning with the poorest and ending with the best; 
in this case only one drawing can be assigned to a given position. 

All scoring is to be strictly individual. Do not examine the back 
of the drawings. 

4. Use of " Type " Drawings for Controlling Judgments 

In the preliminary distribution without the legend it was 
found that the last or top drawing of a group exerted an 
undue influence in scoring subsequent and somewhat similar 
samples. No marked errors occurred so long as the last 
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scored sample fell within the dominant features of the group. 
But it would happen that an irrelevant feature or an exag- 
gerated accessory, e. g., an unusually good fire engine, or a 
house on fire in the drawings of the * Figure in Action/ 
would appear in a sample and tend to detract attention from 
the essential features that should have prevailed in the dis- 
tribution of the samples. To prevent errors arising from 
such a source, the judges were instructed in the ' directions ' 
(see above) to select a representative or ' type ' drawing for 
a score group as it was being formed and to place it con- 
spicuously beside or in front of the score group. The draw- 
ings in front of the score groups in the accompanying photo- 
graph were the ' types ' selected by a judge while scoring the 
brush drawing of a tree. The * type ' could be changed if a 
more representative one appeared. The judges were uni- 
form in affirming that these ' types ' stabilized their judg- 
ments. 

As soon as a judge had completed a distribution of all 
drawings of a theme, the median sample for each pile of the 
' score intervals ' was found by arranging all drawings of the 
interval in a serial order from the poorest to the best. (See 
instruction to judges.) 

5. Results from Preliminary Distributions 

Since every sample was registered in ledger-fashion, it 
was possible to post its scores on the same line. A portion 
of such page appears here as a sample. 

J 21* (15) 61-65; 71-75; 61-65; 66-70; 56-60. 
22* (15) 76-80; 61-65 



23* (13) 66-70; 61-65 

2^ (13) 4<^5o; 56-60 

27* (14) 76-So; 76-80 

28* (16) 81-85; 81-85 



66-70; 46-50. 
71-75; 66-70. 
56-60; 31-35. 
86-90; 61-65. 
91-95; 81-85. (checked.) 



* J ' means that these drawings were done by pupils of 9th 
grade, ' 3 ' means that they were * figures in action,' number 
in parenthesis shows pupil's age, and the numbers to the 
right are the scores assigned by four different judges; speci- 
men J 21* was scored by five judges. 
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Those samples receiving the same score by three of the 
four judges or by four of the five judges, or the same score 
by all of the judges were checked as possible specimens 
for the scale. 

The drawings of * house ' were thus distributed by five 
judges, those of * rabbit ' by five, and ' figure in action ' and 

* brush drawing of a tree ' by four judges each. Table Ila 
shows the results of a single distribution by one judge. 
Eighteen similar tables were constructed for as many com- 
plete distributions. Tables lib, tree, and lie, house, are the 
combinations of two and five tables, respectively, of single 
distributions. Eighteen similar tables are on file for every 
complete distribution. 

A casual study of the tables show that the drawings of the 
first four years are largely scored within the first quarter 
range, 0-25, of the weighted legend, that the fifth, sixth, and 
seventh years are scored within the first and second quarter 
ranges, 0.45, and that the eighth, ninth, tenth, and eleventh 
are scored, for the most part, in the third quarter range, 
50-75. Out of 680 houses done by the four higher grades 
(8, 9, 10, and 11) not quite seven per cent were scored in 
the fourth range, 76-100. 

The drawings of grades five, six and seven were distrib- 
uted with marked frequency throughout the range of the 
l^end, and especially the drawings of the ' tree ' and of the 

* figure in action.' 

The column headed ' Grade of Mode ' shows the school 
year that contributed the most drawings to the score-step 
shown in the column to right of * total ' ; e. g., in Table lie, 
c means that the second grade contributed the most samples 
to step 26-30. The column headed ' Type ' contains the 
S3anbols of drawings chosen by the judges as the most repre- 
sentative drawings in the respective score groups; e. g., in 
Table lie, K48^ means that the drawing bearing that symbol 
and done in the loth school year was chosen to represent the 
score value of 51-55. The column headed * Median sample ' 
rasters drawings that fell in the median position when all 



\ 



METHODS FOR GROUPING THE SAMPLES 



1 X 
1 « 

t u. 
t u. 

I a 

t u 








7 


i^^iilJ-»l=:^;^::^. 




''1 


J 5 : ' -• t s. J 




I 


;iJiJJs=-;=?4in^ii: 




W 


ilia)oOO<JU.u.l:*«t!,3:oi,Hij.i,scx; 




; 


i : : ; 5 1 1 3 5 i J t ; : 5 ! ; ; ; : 


J 


mi 
till 
til 

Ml 
lew 

(«J 

V 


- - - s i ^ J s ' '^ • " < « 


i 
i 

3 
• 

; 

s 

5 


m 









iVv 



METHODS FOR GKOUFING THE SAMPLES 



ii 

h 

I 



I-, 



r j"i 






i,-3 









uCi'->i3'iWWa:'<oi3'<'^ ■uG'-''3^ ' ' " 



5Vl^5C;C«'5'^0'5t'-■^^>^^• 






^^3 t» r-f-S ^£ 



's»^C'""s"-^'*«'^ 



:i=Js:rr:ifc:5*? 



UOOOottit-iafl'>StJn!j s I X o ab^o ~i -J^ 



i:SsS»*>:5i4ii?c«i 



METHODS FOB GROUPING THE SAMPLES 



Si 



s s S. 

s e : 

a S. 










?■*!: 






;^s& 



•<-^O^i»^c3 *:tb^tf a^^Xx^^acC^^^ 



rocl-OcJCJ^ ^ '"' ^^^. 









METHODS FOR GROUPING THE SAMPLES 



21 





i 

2 

e 
tt 

Uj 


IT 

U 

> 2 





« t s « 

« %k c X 1 
« »- ^^ ** 




' 4 


-1 
se 








c9 


9^ 5 






«5 2l 
•* 






4 -v 


•<000«OQOUJck« X <h 3:xH\-\t^V^\-)t-3>^ 




•• s ;i 

^ JO #^ 




1 
% 

F 

t 
E 


iUis 
tdfst 


-^ Ore 

> ^ f* 


xK ^ <f^ -^ tn <0 t\ 

£r t ^ •^ ^ 




[• 




°52 





s5 

O 

o 









^ 



It 
t2 



Si 

** a 



*s 



ti.2 « 



1 






1 



•2 



O £3 4) 

• O " 
^ V S 

■Sv 8 

fe'3 

vi 

00 



&§ 



•^ 80 



•^5 



§• o 
n g^ 

-«« 



ir **-? 



•> i? 



22 METHODS FOR GROUPING THE SAMPLES 

the samples of an interval were distributed in a serial order 
from the poorest to the best. In addition to the median, four 
drawings just better, and four just poorer, than the median, 
were recorded as * near medians ' which afforded an addi- 
tional control in selecting samples for further treatment. A 
complete record of such ' near medians ' is shown in 
Table lib. The computed median of each grade or school 
year distribution is given under ' medians ' and just above 
the frequency distribution column of the grade. 

In these and similar tables based upon the distribution of 
' house,' * rabbit,' * figure in action,' and ' tree,' the drawings 

TABLE III 

Showing Median Score by School Grades 

(Distribution Under Control of Legend) 













School Grs 


ides 
VII 


VIII 


IX 


X 


XI 




Themes Kdgtn. 


I 


II 


III 


IV 


V 


VI 


X 


House . . .4.68 


10.72 


16.95 


20.53 


II. 41 


23.99 


31.45 


34.78 


40.22 


49.62 


47.99 


69.11 




Rabbit . . 


6.27 


8.12 


16.46 


25.50 


31.71 


40.80 


43.32 


69.84 


80.50 


90.50 


85.50 


94. 


Figure in 


























action . 


9.22 


14.08 


16.86 


18.09 


24.32 


38.49 


33.68 


45.50 


68.49 


71.61 


68.99 




Tree .... 


6.80 


9.3a 


30.64 


51.74 


57.24 


57.33 


60.85 


61.22 


63.49 


67.65 


73.07 





The Median Score was computed from the grade distributions shown in Tables Ila. b. c. ar 
These Scores show roughly the Progress of Drawing through the grades as determined by the Le 
distribution. 

of each school year as shown by mode, type, median, and 
' near median ' samples, conform in the main, exception to 
be noted later, to the general order of the students' progress 
through the grades. The same fact is expressed about these 
four themes in Figure I, based upon the computed median of 
the scores in a grade distribution. See also Table IIL 

The rise of three of the curves is gradual, with no plateaus 
and with few set-backs. The house curve, with the excep- 
tions of fourth and tenth year, is rather remarkable for its 
gradual uniform rise. But the achievements in the bnish 
drawing of a tree follow quite another line of progress. 
Table lib shows that samples from fourth (E), fifth (F), 
and sixth (G), grades were scored with well nigh equal fre- 
quency along with those of the junior and high school grades. 
The rise of the tree curve. Figure I, is steep until the fifth 
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year is reached, but from then to the tenth year, the improve- 
ment from year to year is slight, forming a marked plateau. 
A possible explanation of the form of the tree curve may be 
found by comparing the score values of the tree drawings 
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Fig. I. — Showing comparison of median scores by grades. Scoring controlled 
by legend and t]rpe drawing. (Rabbit ciu've based upon medians not given 
in Table III.) 

with the principles of the legend. The third score group of 
the legend has a range from 31-55 (see legend for represen- 
tation) and received drawings with degrees of merit in 
proportion and form. It appears that the use of the brush 
enables pupils in the earlier school years to achieve success 
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26 METHODS FOR GROUPING THE SAMPLES 

with this principle only. A drawing, to be scored higher 
than 31-55, for example in the 56-75 score group, must show 
" minimum of artistic qualities such as growth, texture and 
structure in * * * living forms." It should also be noted 
that defects in proportion and in relation between parts in 
a brush drawing of a tree are not as evident as the same 
qualities in a house, an animal, or in the human figure. 

The tree drawings done by all of the higher grades, begin- 
ning with the sixth, expressed, according to the judges, only 
a minimtun amount of the artistic qualities as specified in 
score group No. 4 of the l^end. This fact doubtless accounts 
for the marked plateau in the tree curve. Similar plateaus 
in children's drawings, some beginning with the fourth year, 
have been found by Barnes, Lukens, Childs, and others. 

There is a decided drop in house, rabbit, and figure in 
action curves, Figure I, at the fourth grade, and a similar 
drop in figure in action and rabbit occurs at seventh grade. 
This latter drop is made more noticeable by the rapid rise 
of both curves in the eighth and ninth grades. A con- 
sideration of the probable cause or causes of these fluctua- 
tions and sudden ascents is postponed to Part II, when more 
material is available. 

Figures Ila and lib of house samples, and those of Ilia 
and Illb of trees, based upon the absolute number of score 
frequencies (Tables lib of tree samples and lie of house 
samples), show wide range of achievements in all school 
grades and marked overlapping in both directions; i. e., the 
scores of any grade coincide with those made by grades 
above and below it. House samples of third grade, for 
example, were scored from 1-5 to 66-70 and those of sixth 
grade from 1-5 to 71-75 showing a slight range above the 
third grade. This condition is similar to the findings of 
pupil achievements in other school subjects, as reading, spell- 
ing and writing (Starch, E. D.), arithmetic (Woody, C.) and 
in history (Bell and McCullum). An inspection of the 
figures shows, however, that the upper limits of the curves, 
with exception of that of house in tenth grade, end in the 
order of the priority of the school year. 
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III. SELECTING AND SCORING SAMPLES OF 

EACH THEME 

I. Type, Median, Near Median, and 75;^- Agreement 

Drawings Chosen 

It was now possible to select drawings from four sources 
for further treatment : ( i ) those that had been * types ' 
during the distribution; (2) those that had been placed in 
the median position when the samples that had been given 
the same scoring were serially arranged; (3) those receiving 
the same score by 75^ or more of the judges ; (4) those that 
had been ' near medians ' in the serial distribution of the 
scored drawings. It happened at times that the same drawing 
served as type, later as median, and finally received similar 
ranking by three-fourths of the judges. Samples that did not 
fall in one or more of these four classes were rejected. 
Samples having such a history or pedigree were used in 
making up a list of 63 drawings for the next type of scoring. 

These 63 drawings selected under controlled conditions 
had a range of qualities embodying the essential principles 
of drawing in Representation and extending throughout the 
public school grades, i. e., they showed the entire gamut of 
drawing achievements as now done in the public schools. 

2. Rating the 63 Samples by 22 Judges 
The drawings were now re-6cored by 20 or more judges 
under the guidance of the legend. The directions for scor- 
ing were similar to those used in the former distribution 
with the exception that the ' type ' was omitted — ^no longer 
needed — and that the median was not placed or located 
among samples of each score interval by serial arrangement. 
The distribution was made on long tables (see photograph, 
page 14) and a sample was scored wherever it was deposited 
by a label bearing a score interval. Sixty-five of the 92 
judges participated in this work. Twenty- four or 37^ were 
teachers of drawing or artists, 34 or 52;^ were public school 
and college teachers, and 7 or ii%' were laymen and art 

students. 
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TABLE IVe 
Showikc Distribution of Scores on 19 of 63 Sampies Made bv 21 Judges 
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TABLE IVd 
Distribution of Scores on 19 of 63 Samples Made by so Jci 
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TABLE V 

Showing History of a Few of the 63 Samples Chosen for 

Further Distribution* 



Theme 


Name of 
sample 


Median 


Near median 


Type 


75%-Agreement 


House. 


B i» 
A 17* 
B 131* 
K89* 

Kio« 

Uf 
E6o« 

As' 

K37' 

L5' 

H180* 
I 61* 
L 10* 
E16* 


Median 












Type 
Type 
Type 








Near median 


75%-Agreement 


Rabbit. 


Median 


Near median 




Type 


75%-Afl:reement 




Median 






Figure 




Type 
Type 




in ac- 
tion. 

Tree. 


Median 


Near median 


75%-Agreement 
75%-Agreement 
75%-Agreement 




Median 








Near median 








Type 


7S%- A flrr eement 











* It should be borne in mind that three samples were chosen for each of the 
score intervals ranging from o to loo, e. g., three drawings rated 1-5 were placed 
in the 1-5 interval, the three in each interval being of about the same value, 
of course. 



3. Basis for Selecting 21 Samples 
A. distance between median scores 

The results of scoring the 63 samples of each theme are 
assembled in Tables IVa, b, c, and d. Tables IVb and IVd 
present only those samples that were later chosen for scor- 
ing in the serial distribution. 

Since 21 score intervals appeared to have sufficed thus 
far for scoring purposes, it was decided that the authors 
should select 21 samples from the 63, discarding 42, and have 
them redistributed serially, i. e., have them arranged in a 
series from the poorest to the best. 

The samples are listed in the tables according to the array 
of the median values computed from 20 or more judgments 
on a single sample. A study of the tables shows that the 
difference between successive medians in the array for 
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figures in action varies from o to 5 units, for houses from 
o to 11.09 units; this latter difference occurs next to the last 
in the array and is more than twice the size of the usual larg- 
est steps. The distance between the steps, according to the 
medians, in the rabbit array — not shown in the table — 
varied from o to 5.83 units, and the distance between steps 
in tree array varied from o to 8.08. 

The number of times in which there was zero difference 
between adjacent medians in scoring the drawings of the 
house was 6, the number for the tree scoring was 7, and in the 
case of the rabbit and figure in action 11 and 13, respec- 
tively. It is suggested that the relatively small number of 
zero differences between adjacent medians occurring in the 
case of the house drawings point to a greater variety of dis- 
tinctive, progressive, and recognizable differences. The fine 
graduated differences in the living forms, rabbit and figure 
in action, are much more difficult to discriminate, and as a 
consequence, a greater similarity of grouping occurs. The 
average difference between the medians is highest for the 
house drawings, 1.99 units, while for the tree it is 1.33. 
The average difference for rabbit and figure in action stand 
1.37 and 148, respectively; the greater difference of the 
figure in action is not clear. 

It would have been possible, if desirable, to have selected 
12 or 15 samples from the 63 with well nigh equal differences 
between their medians. Fourteen samples, not including 
zero, whose successive medians differed each by an interval 
of 6- and A D-.22 could have been selected from the draw- 
ings of rabbits. Thirteen whose medians differed by an 
interval of 6.46, A D-.63, could have been selected from the 
drawings of houses. Fifteen samples whose medians dif- 
fered by a constant interval of 6, A D-1.2, could have been 
selected from drawings in action. When other conditions 
were equal, equal differences between medians determined 
the selection of the sample. In Tables IVa and IVc, the 
symbols of samples and the medians in heavy type mark the 
drawings selected for further scoring. 
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B. ACCORDING TO PRINCIPLES EMBODIED IN THE LEGEND 

If equality of steps between the units of an educational 
scale had been the only object of the search, the investigation 
might well have stopped here. But when the samples having 
medians differing by equal intervals were compared with 
others having unequal intervals and both were checked by 
the principles of the legend, it was strikingly evident that 




^*^' 



some samples occupying equal steps were easily surpassed by 
others having unequal steps for purposes of scale construc- 
tion, e. g., in the figure in action samples K6* and /*' were 
rated 74.7 and 75.5, respectively, by 22 judges, and in the 
process of reducing the number of drawings from 63 to 
21, obviously, one of these must be rejected. While 75* has 
defects as a drawing of a figure in action, as a whole the pro- 
portions are better, the lines more expressive, and the man- 
ner of suggesting the features more desirable at this step 
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in the scale. K6*, while expressing action unmistakably, 
represents so many undesirable features, such as undue 
attention to details, lack of structure and proportion, rather 
than an effort to express the main action lines, through a 
study of direction, proportion, and subordination of details, 
it would, obviously, be of far less use to the pupil and teacher 
than/5*. 

Again, samples Ji* and I$* were rated 80.5 and 80.5, re- 
spectively, by 22 judges, and as such were competitors for a 




place in the scale. While //' has much to recommend it as 
a tjrpe of the figure in action, the lines are hard and angular, 
have less variety and character, and are less expressive of 
the human figure than those of /j*. making 75* a better type 
of drawing for use in the school room at this step in the 
scale. 

A third principle somewhat coordinate with those of " A " 
and "B" employed in reducing the 63 samples to 21 con- 
sisted in making use of some characteristic, other things 
being equal, possessed by a sample over others that qualified 
it for measuring drawing achievements in the school room. 
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This factor will appear upon reading the "analytic de- 
scription of samples " given in some detail with the scale 
pictures. A concrete case may be in order here, however. 
Sample Aiy^, median value 8.14, No. 3 in the house scale, 
competed with two other samples having medians 7.8 and 
8.5, respectively, and was chosen because it represented more 
clearly than either of the other two the common failure of 
pupils at this step to distinguish between the upright line 
that represents a comer of a building and the line that forms 
a part of the gable end. The two lines are drawn by the 
pupil as one and the same straight line. 

The 63 samples of each theme were repeatedly worked 
over in this way until a set of 21 samples were chosen. 

4. Scoring 21 Samples by Serial Distribution 

The directions to the judges for this final scoring, were 
as follows 

To the Judges: 

You are asked to arrange the 21 drawings enclosed in this envelope 
in order from the poorest to the best, and record the order that you 
assign to each drawing on the enclosed blank sheet 

In judging the drawings consider them from the standpoint of 
" representation " only. Observe such features as proportion, balance, 
light and shade, and quality of line to show growui and texture. 

The legend was not used. 

Thirty-two of the 92 judges scored the drawings by the 
serial method. The status of the judges in their relation to 
art knowledge and experience is given here in tabular form. 

Drawing theme No. of judges who No. of judges who 

taught drawing had not taught 

drawing 

House 7 7 

Rabbit 10 2 

Figure in action 7 S 

Tree i 13 

A. RESULTS OF SERIAL DISTRIBUTION 

Tables Via, b, c, and d show the results of the serial 
distribution: the medians, and the per cent rank of each 
sample in the total distribution. The high d^^e of corre- 
lation between the array of the per cent ranks of the serial 
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distribution and the array of the medians of the " legend 
distributions " (Tables IVa, b, c, and d) offers a somewhat 
mutual check on the validity of the two methods. Pear- 
son's " Method Adapted to Rank Difference " was used. The 
formula, in which r is the d^^ree of correlation, is 

1?= I — mr r 2_t\ • The computations showed the r of the 

two methods for house samples to be .99, for figure in ac- 
tion to be .95, for rabbit samples to be .98, and for tree 

samples to be .96. 

TABLE Vie 

Showing Comparison of Serial and ' Legend Distribution ' of 

House Samples 

SampfoB Serial' dist. Legend Differences in rank D S(D*) 

per cent rank ditt. + — o 

array 

A60 I I O O 

Bl 2 2 O O 

A17 3 3 o o 

B131 4 4 o o 

B1S2 5 5 o o 

D59 6 6 o o 

Dq4 7 7 00 

H89 8 8 o o 

G92 9 9 00 

K53 10 II I I 

H69 II 10 I I 

H120 12 13 I I 

J6a 13 14 I I 

H106 14 12 2 4 

}59, 15 17 2 4 

K4IS 16 15 I I 

J3 17 16 I I 

T109 18 18 o o 

K7S 19 19 o o 

K89 20 20 o o 

L200 21 21 o 

Totals .. 5 —5 14 

6x14 , 

^ = ^"^ ^40 ~ •^' whence r = .99 

In the serial distribution it was found that the position 
of the medians in array did not in all instances conform 
wiA that of the per cent rank. This occurred in two samples 
in Table VId. The array of per cent rank is allowed to pre- 
vail, since it forms the basis of the final array of the samples 
in the scale. 
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IV. ARRANGING SAMPLES IN THE SCALE 

I. Probable Error Taken as Unit of Measure 

Between Medians 

The rank given a sample by the judges depended of course 
upon the degree of its qualities in relation to those of all 
the other samples. It was a rank based upon merit. An in- 
spection of Tables Via, b, c, and d shows that judgments of 
merit of a sample tended, with but minor exceptions, to 
greater frequencies about the median rank, and to grow less 
and less above and below that point. The effect of such a 
spread in the distribution of the judgments produced over- 
lapping, so-called, of merit between adjacent and near-adja- 
cent samples in the median array, so that a certain per cent 
of the judgments of a lower sample might extend beyond one 
or more medians of higher samples, while still other per cent 
of judgments of the same sample might reach below the 
median or medians of lower samples. Advantage is often 
taken of this form of distribution in scale construction to 
measure the distance between medians of adjacent samples 
or groups. To do so implies the necessity of assuming that 
judgments of merit or of rank conform to a normal surface 
of distribution and that distances on either side of the median 
line of such a surface may be measured off on its base line 
in terms of the median deviation or probable error. 

The P. E. thus becomes the unit (perhaps the best avail- 
able at present) for measuring distances between adjacent 
medians of groups in serial distribution. 

Attention is here directed to those properties of the P. E. 
that make such applications possible. Fig. VI shows a nor- 
mal surface of frequency. The line dM is drawn perpen- 
dicular to the base of the distribution surface so that 50 per 
cent of all judgments lie on one side of dM, and 50 per cent 
on the other side. The point where the perpendicular cuts 
the base is the median point. The perpendicular line ^ is so 
drawn to the right of the median point that just 25 per cent 

42 
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of the judgments lie between it and the median dM. A 
similar perpendicular cb is drawn to the left of the median. 
The area cbef, cut off by these perpendiculars, contains the 
middle 50 per cent of all judgments. The distance bM or 
fM on the base line xy is the Probable Error ; i. e., a distance 
along the base line of a normal frequency surface from the 
median point to the perpendicular on either side of the median 
which cuts off 25 per cent of the cases, is P. E. It has also 




tf. 



Fig. VI. — ^Normal surface of distribution showing the Median and P. E. distance 

at each side of the Median Point. 
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Fxo. VII.— -Normal surface of frec^uency showing P. £. distances from the 

Median Point. 



been found that if a perpendicular be erected at a distance 
of two P. E. on the base line of the surface of frequency, 
and on either side of the median point, it will include with the 
median perpendicular 41.13 per cent of all the judgments; 
if erected at a distance of three P. E. it will include 47.85 
per cent of the judgments ; and if erected at a distance of 
four P. E. it will include 49.65 per cent of the judgments. 
Fig. VII shows the conditions in a graphic way. In the 
present investigation P. E. values above 3.6 were not needed. 

4 
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But Since units of P. E. represent so many per cent of 50 
per cent of judgments it follows that, if the per cent of judg- 
ments above or below the median be known, the correspond- 
ing P. E. distances can be determined. Let if be required 
to compute the distance between the median d^m^ and d^^rn^^ 
on the base line xy in Fig. VIII, assimiing of course that the 
per cents at which the two frequency surfaces mutually over- 
lap are known. The area included by the lines snt^^n bounded 
by the dotted lines is 15.48 per cent of the area included 
within the lines d^m^n. Whence the per cent included within 
the area d^m^fh}^s is 50— 15.48, or 34.52 per cent. The P. E. 
equivalent of 34.52 per cent is 1.507. Also the area included 
by the lines rrn^p of the frequency surface bounded by the 
continuous lines is 84.25 per cent of the entire frequency 
surface, since the per cent included within the area d^^m^^rm^ 
is 84.25 — 50, or 34.25 per cent. The P. E. equivalent of 34.25 
per cent is 1.490. Two measures, then, have been found for the 

distances m^tn^^ on the base line xy. The average ^^S^ZdiM^o^ 

or 14985 P. E., is nearer the exact measure. To apply these 
processes of computation to determining the distances between 
the median judgments of each of the 21 samples it was only 
necessary to arrange the medians in an array, together with 
the frequency distribution of each sample. These are shown 
in Tables Via, b, c, and d, also the per cents of the fre- 
quencies within a distribution. Table VII was derived from 
basic Table Via. To aid in interpreting the directions for read- 
ing these tables, a computation of one distance is here inserted. 
Let it be required to determine the distance in P. E. units 
between the median 6.66 of sample D64 and median 7.67 of 
sample H8p of Table Via. Observe that four (arrived at by 
interpolation) of the 14 judgments of samples D64 were equal 
to or beyond the median 7.67 of sample H8p. That is, 28.57 
per cent of the judgments regarded sample D64 equal to or 
better than median judgment of sample H8p, Hence, 50 
per cent minus 28.57 P^^ cent, or 2143 per cent, makes the 
upper extension of sample D64 value — ^judgments that coin- 
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cide with median judgments of sample H89, The P. E. equiv- 
alent of 21.43 P^r c^"^ ^s .8392. Moreover, one judgment in 
sample H89 distribution extends to or below the median 6.66 
of D64, Hence, 13 — 7, or 92.85 per cent minus 50 per cent, 
or 42.85 per cent, equals the distribution of judgments in the 

TABLE VIII 

Showing P. E. Equivalent of Difference Between 50 Per Cenf 

AND Per Cent of Overlapping Judgments for 

Adjacent Samples : House 
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This Table is deriyed from Table VII. Upper P. E. values refer to judr 
ments of higher sample that extended to or below adjacent median of lower 
sample; lower P. E. values refer to judgments of lower samples that extend to or 
above adjacent higher median. 



minus half of sample H8g. The P. E. equivalent of 42.85 
is 2.1715. The average of .8392+2.1715 is 1.5053, which is 
the distance in P. E. units between the samples in question. 
Tables VII and VIII show all the computations for the serial 
distribution of house samples. The fifth column of Table VIII 
shows the average of P. E. values of each interval between 
the medians. The summation of these averages is presented 
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in the sixth column and shows the distance of each sample 
above zero, as well as the distance between individual samples. 
The distance from the zero sample A6o to sample Bi is 
arbitrarily ^ taken as i P. E. The seventh column shows the 
final scale values obtained by discarding all figures to the 
right of the decimal. This has produced remarkably uniform 
scale values for the house samples concerned. The results of 
this form of distribution appear to back up in every instance 
those obtained under the control ' legend.' The scale values 
as computed by the overlapping method for the remaining 
three themes appear in the eighth column of Tables IXb, c, d. 
These values, despite the higher correlation between the serial 
and legend distribution, rest upon a number of minor varia- 
tions that cast some doubt upon their validity and led us to 
reject their use on the scale samples. Some of the variations 
could have been prevented if the conditions causing them had 
been foreseen in time ; e. g., a larger number of judges would 
doubtless have smoothed out some of the irregularities ; others 
inhere in the nature of the work itself. 

A full discussion of all the facts would contribute but little 
to the scale, but the more serious ones are given in order to 
make clear the reasons for substituting the per cent method 
for that of overlapping in scaling the distances between the 
samples. Table VIb shows that the highest values assigned 
to sample C23 does not reach the lowest value given to sample 
Fs^, the next in the median array. Such a condition pre- 
vents the direct use of the overlapping method. An inspection 
of Tables Vic and d shows that the same conditions occur 
between the second and third samples of figure in action and 

^No way has as yet been devised for measuring satisfactorily the 
ictoal distance in such cases. There is no general agreement as 
to die nature of the facts upon which such measurement must be 
oomimted. The psychologists might be satisfied with some method 
that would register the growth and coordinations of the psycho- 
physical processes involved in the transition from infantile scribbling 
to the first meaningful effort We have preferred to allow the inten- 
Utm of meaning as an observable fact to register the difference ; but 
IS diat is not a numerical measure of the distance we are forced to 
make an arbitrary assumption. 
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of tree. We are persuaded that such conditions are due 
to an over-elimination in reducing the 63 samples to 21. The 
differences between the samples at the lower limits of the 
scale appear to be too great by this method. Only use can 
show whether or not that is a practical defect. 

Figure VIII illustrates the absence of overlapping of 
medians in the case of the frequency surface qdt. Several 
pairs of medians of serial distribution have zero differences, 
e. g., rabbit samples. Table VIb, have two pairs of similar 
medians (ffp7 — H5J and H^i — lip) ; figure in action sam- 
ples, Table Vic, have two pairs (L^ — /14 and I58 — K3) ; and 




t 10 riglll. No part of lurfoce adt 
■urfacn aJ'r and bd"t mutiutlr 



tree samples. Table VId, have four pairs of similar medians. 
Only two samples. Table Vic, show similar ranking by the 
per cent method. 

It is not urged here that the adoption of the per cent 
method has removed the minor difficulties and inconsistencies 
encountered in the use of the ' overlapping ' judgments, but 
rather that it obviates the necessity of dealing with them. 

The per cent method, like that of overlapping, measures 
the distance between scale values by means of P. E. units as 
derived from a normal frequency distribution. Its applica- 
tion in the present instance is based upon the assumption that 
the achievements in drawings as represented by the values 
found in the 21 samples are distributed according to a normal 
frequency surface; that the samples, owing to the manner 
of selection, show the range typical of drawing achievements 
as now done by the entire public school groups. It follows 
that if drawings of such groups be distributed according to 
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these values by far the largest number would fall on and 
near the values occupying the median position between the 
poorest and the best, and that the number of frequencies 
would become less and less as distances increase plus and 
minus from the median value. To return to the 21 samples, 
if now the per cent rank of each of the 21 be ascertained 
and the respective distances above and below the 50 per cent 
rank be known it is possible to determine in P. £. unils the 
distance from the median or 50 per cent and from these 
values one may construct in turn a scale in linear projection 
banning with zero value. The arithmetical computation 
is simple enough; the base upon which the per cents are 
reckoned is the number of assignable positions times the num- 
ber of judges ; for example, in case of house samples the 
base is 21 times 14, or 294. The absolute rank of a sample 
is the stmi of the products of the respective serial numbers 
times the judgment frequencies. The per cent rank then of 
a sample is derived from its base and its absolute rank. 

Tables Via, b, c, and d show these ranks in the last column 
to the right and from this column Tables IXa, b, c, and d 
were constructed. A brief description of these tables will 
indicate the steps involved in determining the final scale 
values. The fourth column shows the difference between 50 
per cent and the per cent of rank of each sample. The value 
is minus if the rank is less than 50 and plus when it is more. 
The P. £.^ equivalent of these plus and minus values is shown 
in column five. The zero sample in each theme is arbitrarily 
set I P. E. below the P. E. value of the next sample. Thus 
die P. E. value of A60, house sample, Table IXa, is set at 
minus 3.319S below the median for the reason that sample 
Bi just above has P. E. minus 2.3195.= Locating the dis- 

* P. E. is computed from Table 48 in " Spelling Ability " by B. R. 
Bod^ighain, a variation of Table 44, page 198, of Thorndike's " Men- 
tal and Social Measttrements." 

'A dear exposition of this method may be found in a monograph 
by Henry Gustav Hotz, "First Year Algebra Scales," Teachers^ Col- 
lege. Columbia University, 19 18. See also. '* A Scale for Measuring 
Pupils' Ability to Demonstrate Geometrical Theorems " by J. K. Min- 
mek, Scliool Review, February, 1919. 
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tances of the remaining samples consisted in subtracting the 
minus P. £. values from that of zero sample and in adding 
the respective P. E. values. The results as shown in column 
six were converted into final valups by moving the decimal 
one place to the right and cot|ntio^"di6*decimal to the nearest 
whole as an integer. Tbe$e.iulae^ appear on, and, of course, 
determine the order'X>^,'the'«amples in the sale. 



• * 



2* Basis f6r Futher Elimination of Samples 

'. Although the serial distribution contained 21 samples the 
: \.\ '; number finally assigned to each scale was slightly less in 
each case. The number stands : house, 20 samples ; tree, 19 
samples; rabbit, 18 samples; and figure in action, 16 samples. 
The bases for elimination were in general two : if the ratings 
on two drawings gave identical medians the less serviceable 
for the step in question might be dropped; or again, if a 
sample duplicated the significant features of the two samples 
on either side and added nothing new on its own account, 
or was significantly lacking in features better expressed by 
adjacent samples for that step, it was omitted; or again, if 
there was a reversal of the median array by the per cent rank 
such a condition was regarded as ground for rejecting one 
or both samples. Tables IXc, sample Dp8, and Table IXd, 
sample 16^, show one reversal each. But if such a sample 
added some significant feature and was backed up by the 
legend distribution it might be retained ; this applies to the 
tree sample I63. 

From the house series samples K^j, serial score 9.4, scale 
value 30, was omitted because it failed to express proportion 
of parts and ability for handling typical drawing principles 
for this section of the scale, better expressed by adjacent and 
other samples. 

From the rabbit series three samples were omitted : H63, 
serial median 9.5, because its median was identical with that 
of /fp7, and unlike the latter it failed to express proportion 
and due relation of parts typical at that step of the scale. 
All the pertinent characteristics of H4S were duplicated by 



ARRANGING SAMPLES IN THE SCALE 53 

7^7. The serial and ' legend medians ' of l2g duplicated 
both of those of H51. 

From the figure in action series five samples were dropped 
for the reason that their places were equally represented by 
an adjacent sample either above or below. Their presence 
contributed no new feature to the scale. An inspection of 
Table Vic shows that some of these duplicated the medians 
of adjacent samples and one sample, C150, has the same per 
cent rank as an adjacent sample, but lacked features character- 
istic of this section of the scale. Only two samples were 
dropped from the tree series, despite the fact of many dupli- 
cate medians. The per cent rank of the trees presents no 
duplications, and besides the samples having similar medians 
are all different species of tree and on that account, while not 
adding anything decidedly significant to the scale, show a dif- 
ferent sort of achievement. 

Before leaving this section of the scale attention is directed 
to the fact that each sample won its place, as it were, by a 
series of competitive tests, the conditions of which it will 
be observed were kept objective as far as possible. In gen- 
eral, three methods have been applied : ( i ) A rough * type- 
iiiedian-75 per cent-agreement ' plan. (2) Use of the legend 
in controlling distribution of 63 samples. (3) The serial plan. 
The statistical pedigree of any sample may be traced by in- 
specting in succession the following tables : IV, VI, and IX. 
Figure IX shows a comparative view of linear projections of 
the scales of each of the four themes. The linear projections 
of house and rabbit scales show more uniform distances 
between scale tmits. 

3. Analytical Description of the Samples 

The description of the samples is pedagogical in its aims, 
intended to aid teachers and pupils in the use of the scales. 

The descriptive matter appears under the scale pictures 
to be found at the end of the study. 

This function of scales is sometimes questioned and, per- 
haps, properly so for some scales, but no sufficient reason 
appears for limiting drawing scales to merely measuring 
results. 
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4. Directions for Using Scale 
A. directions to pupils 

Turn to the theme on thp scale folder that is similar to 
your drawing. Move your drawing along the scale until a 
sample is found that appears to match it. Read the descrip- 
tion of the sample given below and see if it describes your 
own drawing as well. If the description does not apply so 
well to your drawing, read that of the sample next below 
in the scale and also compare your drawing with the scale 
samples. Now, if your drawing matches the sample and fits 
the description, write on your drawing the number in the scale. 
But, if the second sample and its description is not so good 
as the first, go to the sample and description that is just above 
the first that you used, and make a similar comparison and if 
this is more satisfactory than either of the other two, give to 
your drawing the score similar to the number on the sample. 
This number is the score of your drawing. 

If you wish to get your standing for drawing in repre- 
sentation, as it is called, make four drawings from memory ; 
a house or any other kind of building, a rabbit or squirrel, a 
tree, and a boy running. Then grade each according to the 
directions given above and find the average of the four grades. 
The average scale value that is nearest is your standing in 
drawing as measured by the scale. 

B. directions to teachers 

To score a drawing compare it at least with three draw- 
ings of the scale in the manner of the directions given to the 
pupils. To ascertain the standing of a class: (i) Classify 
the drawings according to themes. (2) Place the scale folder 
on blackboard molding or other support. (3) Score all 
drawings of the same theme before passing to those of 
another and record the scores in the blank space provided 
in the score sheet as given in the text. (4) Compute the 
median and average for each theme separately. (5) Average 
the medians for the different themes thus scored. The scale 
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numbers nearest to the average of the medians is the class 
standing for drawings done in representation. 

A form of the score sheet is given here, and in it are shown 
the scores of 20 drawings of houses done by the 7th grade 
and 20 drawings of trees done by the 5th grade. The median 
score for the house drawings of the class is 26, which is 
nearest to scale value 25 written on sample D64, This scale 
sample thus becomes the measure of the 7th grade drawings 
of houses. The median score of the 5th grade drawings of 
trees is 20, which is the same as the scale value of sample 
C186, This sample then becomes the measure for the tree 
drawings of the 5th grade. The same drawings were scored 
to the scale by two other judges. The scores of the' three 
judges are given here. 

House Tree 
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Judges Average Median Average Mediam 

1 27 26.S 21 20.5 

2 28.75 28.00 29 28 

3 28 27 27.50 27 

5. Desirability of Standardizing the Scale 

" To the teacher of artistic temperament who objects that 
accurate grading of work in drawing is impossible, that much 
work is dependent upon sentiment, is intangible, and should 
be left tmmeasured so far as the pupil is concerned, the 
answer is that measurement in drawing is constantly being 
made through * grades ' or * marks ' which are given to 
children." This quotation from Wilson and Hoke " How to 
Measure," written in the interest of measuring school art 
according to scales applies with equal force to standardizing 
the achievements of public school drawing. It is doubtless 
true that we have acquiesced all too long in the notion that 
the products of drawing were due to more or less mysterious 
gifts independent of methodical instruction and painstaking 
effort. When it is once realized that drawing talent, so-called, 
shares in equality of distribution with the gifts involved in 
the mastery of the other common branches, and that higher 
products of art are made possible by the mastery of its f unda- 
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Send drawings with scores to— 
L, W. Kline, Saratoga Springs, N. Y., 

Gertrude L. Carev, Duluth, Minn. 
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mental technique and by reducing to habit and to ' graphic 
language ' the fundamental art norms, the desirability of hav- 
ing reliable standards and norms becomes apparent. 

Teachers of art in Public and private schools are earnestly 
asked to co-operate with the authors in this work of stand- 
ardizing the present scale by forwarding to them drawings 
done from memory in their school rooms. It is highly desir- 
able that teachers use the form of score sheet shown above, 
and send both their own ratings, and the drawings. 



V. GENERAL ASPECTS OF TEACHING DRAWING 

Inasmuch as children begin to use drawing to express 
ideas almost as early as the spoken language, we are justified 
in assuming that the native equipment for drawing is at least 
equal to that for any other subject, and that approximately 
the same progress can be expected in drawing as in other 
subjects under similar instruction. 

Imitation is strong in childhood and continues through 
adult life. During the first few years of the child's life, 
practically everything is secured through imitation. Some 
educators object to imitation when it comes to drawing, on 
the ground that it interferes with free expression. On the 
other hand, should it not be an aid to free expression by 
putting the tools in the hands of the child ? 

In too many schools the child's progress is measured by 
what he can say, disr^^rding entirely what he is able to tell 
with his hands. " I can't tell it, but I can show you how 
it looks and how it is done," is too often the answer to ques- 
tions put to children, to be disregarded. This ability to show 
the construction of animals, plants and objects, and to 
illustrate processes through graphic representation is too valu- 
able an achievement to be ignored and bears a very direct 
relationship to constructive work. This view is strongly re- 
inforced by the claim of engineers and by teachers of botany, 
2<^^0i7» geology and all technical subjects. In fact, it is the 
most natural and most accurate means of description, in all 
subjects where a clear idea of structure and relation of parts 
is necessary. 

Teachers should keep in mind the fact that the house, the 
rabbit, the boy running, and the tree, are but types, and when 
teaching these type-forms other forms based upon the prin- 
ciples involved should be studied at the same time, e. g., when 
working upon the house, children should draw boxes, street 
cars, milk wagons, trucks, tables, or other objects involving 
the elementary principles of construction and perspective. 
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While learning to draw a rabbit, draw a squirrel, a dog, a 
horse, or other animals, noting differences and likenesses. 
The cultivation of the ability to compare and evaluate cannot 
be over-emphasized. It leads to discrimination and discrimi- 
nation is the basis of appreciation. We wish also to empha- 
size the point that the representation phase of the scale is 
to be used largely as it supplements and contributes to design, 
composition, and color. Representation is not to be inter- 
preted as meaning an exact reproduction of all the facts 
of form or structure, e. g., the opportune time for drill 
in the drawing of the house is when the child needs to draw 
a house in order to tell a story, such as Red Riding Hood going 
to the house of her grandmother, etc. In many instances, it is 
impossible for the child to illustrate the stories in which he 
revels, unless he is able to draw fairly well the figure in 
action. This furnishes the incentive for drill in the illustra- 
tion of such themes as The Boston Tea Party, Horatius at the 
Bridge, etc. The drill phase should never be emphasized at 
the expense of expression. 
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KLINE-CAREY MEASURING SCALE 

FOR 

FREE-HAND DRAWING 

REVISED 

INTRODUCTION 

The present form of the Kline-Carey Measuring Scale 
for Free-Hand Drawing is a revision and supplement to the 
scale as first published in the Johns Hopkins University 
Studies in Education, No. 5. 

The original study was based upon 5214 sample drawings 
collected from all departments of city public schools : kinder- 
garten, grades and high school. That number by a process 
of controlled selection was reduced to 73, which formed the 
samples of the original scale. The first scale was based on 
the ratings of 92 judges, the revised form on 152 judges, 
so that the final position of the scale samples in the revised 
form is fixed by the ratings of 244 judges. 

The revision has been made for the following reasons: 

(i) The scale values are expressed in a per cent form 
ranging from o to 85-95 ^^^ ^^^ based upon the judgments 
of a comparatively large number of expert judges. 

(2) Both the scale folders and the printed matter accom- 
panying the same have been arranged in a form that should 
make the scale readily accessible for classroom purposes. 

(3) Features that were necessary for scientific exposition 
but that play no role in the practical use of the scale have 
been eliminated. 



KUNE-CAREY MEASURING SCALE 



METHODS OF REVISION 

Nearly 300 sets of picture-drawings — a set was composed 
of all the pictures, 73, of each of the four themes — ^were sent 
to supervisors of art in city public schools, to art teachers in 
colleges and in technical and in state normal schools. 

The following directions were enclosed with each set of 
drawings : 

The drawings herewith enclosed were made from memory and deal 
with four themes: house (20), rabbit (18), human figure in action 
(16), and brush drawing of a tree (19). 

You are asked to ran)c the drawings of each theme in order of 
merit placing the poorest at one end and the best at the other. Make 
as many trials and changes as you wish until you are satisfied with 
the rank assigned to each specimen. No two specimens of the same 
theme may have the same rank. Mark o (zero) on the back of the 
poorest specimen and then indicate similarly the order in rank of the 
rest of the samples by using the digits i, 2, 3, 4, 5, etc. 

After having ranked and marked the samples of each of the four 
themes, place them in the enclosed envelope and mail it at your very 
earliest convenience. 

This co-operation on your part will contribute to the work of fur- 
ther simplifying the use of the scale. 

Attention is called to the fact that the judgments were 
made on the original scale pictures struck from the same 
plates used in printing the first edition. By this plan each 
judge was furnished with a fresh set — so to speak — of pic- 
ture-drawings and the necessity of ranking deteriorated 
drawings from repeated handling was avoided, thus remov- 
ing a source of error. 

There were selected from the returns 152 complete sets 
judged by supervisors and teachers of art as described above. 
The four tables that follow embody the results of these 
judges. The symbols used for identifying the drawings 
in the original scale are still given in the tables to facilitate 
comparison between the original and the present edition. 

The order of the scale samples in the tables and as they 
appear in the scale folders is determined by the median ranks, 
and the distance between any two consecutive samples is 
measured by units of probable error (P. E.). As the princi- 
ples justifying the use of such a measure are presented at 



TABLE I 
Serial Ranking of Picture-Drawings 

THE house: 152 JUDGES 
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I. Samples dropped from revised scale. 

a. The P. E. vahie of each sample above zero is multiplied by 5 after dis- 
carding fraction to the right of decimal point. The factor 5 is obtained by 
dividing 951 arbitrary upper limit of scale, by the sum (19.58) of the P. B. 
values. 



sam 



3. Table I to be read: lai judges ranked sample C or A17 greater tban,(>). 
imple B or Bi, i. e., 70,6 per cent of judges. The P. £. equivalent of 

70.6—50^ is 1.227. The distance from zero (o) sampbe A to sample Cam A to 
B-k-B to C, or 3.S+1.225S4.73. 

4. Both old and new symbols of identification are siven to facilitate 
locating any sample of the present s^ale in the original edition. 



4 KUNE^CAREY MEASURING SCALE 

some length in the original study and in current texts on 
statistical measures, there is no need for repeating the dis- 
cussion here. But to facilitate the reading and the inter- 
pretation of the tables the operations involved in computing 
the scale values are submitted. 

First : Let it be required to compute the P. E. units be- 
tween the second and third samples of Table I. Of the 152 
judges, 121 or 79.6 per cent* ranked sample C better than 
sample B. The difference between 79.6 per cent and 50 
per cent is 29.6 per cent with a P. E. equivalent of 1.227. 

Second : Be it required to compute the distance in P. E. 
units of sample D from A or zero sample. Since B is as- 
sumed to be 3.5 units above A, and C is computed to be 1.23 
above B, and D computed to be 2.24 above C, then D is 3.5 + 
1.23+2.24 or 6.97 P. E. units above A. The P. E. value of 
each sample from zero sample is similarly computed. These 
values appear in the column next to the last in each of the 
four tables. 

For transmuting the P. E. values into scale values ranging 
from o to 90-95 it was only necessary to divide 95, the arbi- 
trary upper limit of the range, by the sum of the P. E. 
values and then multiply each in turn by that quotient. 
Effort was made to find a common transmuting factor for all 
the four themes, but owing to the difference in the total 
amount of the P. E. values of the different themes it became 
necessary to use three factors : 5 for the house scale, 6.7 for 
rabbit and 6 for each of the other two themes. The P. E. 
values of the house samples are comparatively large, pointing 
to quite evident differences in merit between adjacent samples, 
so that their sum, when used as a divisor, gave a smaller 
quotient than that obtained for the rest of the themes, in 
which the P. E. values are relatively small, particularly in 

^A difference in quality between two specimens gjeat enough to 
produce an agreement of 75 per cent of the judges is considered 
sufficient for scale construction. The difference between a few of 
the samples in this scale show a considerably less agreement but they 
are retained for other reasons belonging to art rather than to sta- 
tistics. 
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TABLE II 

Serial Ranking of Picturk-Dkawings 

THE rabbit: 152 judges 



r 



M/mber of 




§§pfe 




MvivMfww 


terJUfei rAnktl 


.. 8#rCJl > A 


7^. If 


*7ff 


^0 
S.7f# 




r 


i*L . 


-Cwrfiry^ 


fi.^^ 


/.w 


C5.HI 


^0 


no u 


. Oorf»> C 


/Sf53 


/.57/ 


4.f^ 


JO 


lOi . 


•> f •rEi)>D 


U!ff 


C50 






/'^ . 


. F*rDi;>D 


ir/5 


w 


F f.^fr 


<if 


n . 


.F-r ->£' 


iiXJ 


j2Jt 






IIX . 


.(Vffft»F 


nxr 


J59 






m . 


..M,^p^f>F 


7CM 


/M5 


ff 4.4// 


M 


n ^ 


.. H .r " >0' 


S5.fl 


M 






ifi • 


.IorWS>H 


7t3/ 


f'.0L5 


I 7,4;^ 


«) 


/3f . 


.J«fHf;>t 


njs 


I.7f5 


J f:«; 


4Z 


"90 . 


• UJiO-T 


SfM 


,5Y4- 


L nn 


4r 


H - 


-X«rHCO>L 


iSJtr 


.^rr 


K 10.270 


w 


?r . 


.^irlif >K 


f7.tr 


J5S 






lit . 


•A#raf;>K 


nil 


.M 


A\ It '20^ 


7r 


// .. 


,/1»r- >6f 


S7A3 


Mf 






Tf . 


,/V*TflV>>W 


5^JX 


.IH 






iJi . 


.Ptrif >>M 


nM 


/.-?« 


? \X,4V 


p^ 


/i^ . V 


,P#r''>y 


nM 


•^f? 






fa . 


^•^iffyp 


StM 


Mr 


^ /X.^4 


f4 


f/t • 


• RtrKIOX} 


7;.cz 


/.PS- 


K\%1ii 


^ 



I. Samples dropped from revised scsle. 

s. The P. E. vslue of esch sample above zero is multiplied by 6.7. This 
factor is obtained by dividing 9S« arbitrary upper limit of scale, by the sum 
(13.94) of the P. E. values. Some of the products are sKghtlv altered, #.^., 
SI to so, 93.39 to 94, etc, in the interest of simplicity. See Table IV on this 
point. 

3. Tabte II to be read as Table I. 
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TABLE III 

Serial Ranking op Picturk-Drawings 
thb rgure in action : 152 judges 
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1. Samplet dropped from revised icale. 

2. The P. E. value or distance of each sample above zero is multiplied bv 6 
to determine its scale value. The factor 6 is obtained by dividing 95,! arbi- 
trary upper limit of scale, by the sum (15.85) of the P. £. values. 

3. Table III to be read as Table I. 
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TABLE IV 
Serial Ranking of Picture-Drawings 

THE tree: 152 JUDGES 
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I. Samples dropped from revised scale. 

3. The P. E. value of each sample above zero is multiplied bv 6, computed 
as in Table III. The fraction of the number is omitted in all cases. Odd 



numbers are changed to even save those that are multiples of 5. 
3. Table IV to be read as Table I. 
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the upper limits of the scale. Only the integer of the P. E. 
values was affected by the factor 5 — ^the fraction being dis- 
carded. Both the integer and the fraction in the other themes 
were affected by the common factor; the P. E. values of 
rabbit themes were multiplied by 6.7 (Table II), and by 6 
in the other themes. See Tables III and IV. 

The steps between samples on the house scale are equal 
for the most part, giving a uniform set of scale values. The 
steps between samples of the other themes are more or less 
irregular but the same values on each of these three scales 
mean practically the same distance from zero, or in other 
words, a drawing of a rabbit or of a dog or of a squirrel 
rated 70-75 on the Rabbit Scale equals in achievement a 
boy running or skating or what not rated around 75 on the 
Figure in Action Scale : two such drawings assigned the same 
scale number as found on the two scale sheets in question 
are assumed to represent the same achievement. 

The tree samples produced the shortest scale, o to 85 only. 
The amount of difference in merit grows smaller between 
samples of higher achievement. Between a few samples 
the difference is so small that the agreement of the judges 
falls to 59-60 per cent. If such samples are retained, how- 
ever, it is because they are of different species of trees. The 
same principle of retention applies, but with less force, to 
rabbit and figure in action having unusually small steps but 
important artistic differences in the plan or style of drawing. 
See samples I, J, and L in Table II. 



FOR FREE-HAND DRAWING 



DIRECTIONS FOR USING SCALE 

(a) To Pupils. — Move your drawing along the scale 
folder until a sample is found that appears to match it. 
Read the description given below the scale sample, and notice 
if it describes your own drawing as well. If tiie description 
does not apply so well to your own drawing, read that of the 
sample next below in the scale and compare your drawing 
with this sample. Now, if your drawing matches the sample 
and fits the description, write on your drawing the ntunber 
in the scale. But if the second sample and its description is 
not so good as the first, move your drawing to the sample 
that is just above the first that you used and make a similar 
comparison. If this is more satisfactory than either of the 
other two, write on your drawing the niunber on the scale 
drawing. This number is the score of your drawing. Again, 
should your drawing have some features that match one 
sample, and other features that match an adjacent sample 
give to your drawing a score equal to the average of the two 
adjacent scale values. 

If you wish to get your standing for drawing in repre- 
sentation, as it is called, make four drawings from memory ; 
a house, or any other kind of building, a rabbit or squirrel, 
a boy running or pitching a ball and a tree. Then grade each 
according to the directions given above and find the average 
of the four scores. This average is your standing in drawing 
as measured by the scale samples. 

(b) To the Teacher. — To score a drawing compare it at 
least with three drawings of the scale in the manner of the 
directions given to the pupil. To ascertain the standing of 
a class: (i) Classify the drawings according to themes; 
(2) score all drawings of the same theme before passing 
to those of another and record the scores in the blanks pro- 
vided in the score sheet as given in the text; (3) compute 
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the median and average for each theme separately ; (4) find 
the scale numbers nearest to these averages and medians. 
They are the class scores for each theme; (5) the average of 
these scores is the class standing in representation. 

To increase the diagnostic value of the scale it should 
be standardized. To this end the authors earnestly solicit 
the co-operation of art teachers and subjoin a table showing 
the form in which reports are desired. 





TABLE 
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Send drawings with scores to — 
L.W.Kline, Saratoga Springs, N.Y., 

Gertrude L. Carev, Duluth. Minn. 
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I. INTRODUCTION 

During the last fifteen years there has been developing 
in university schools of education and in the practice of 
leading educators in the field, what might be spoken of as a 
movement for measurement in education. Teachers and 
schools have always felt the necessity for some sort of 
measure of the results of the educational process. In the 
past we have attempted to measure school efficiency by 
means of examinations and teachers' marks. In recent years 
there has been a growing tendency on the part of 
educators to give up reliance upon examinations and teachers' 
marks, and to depend instead upon the results secured by 
the use of certain tests and scales that have been scientifically 
constructed. 

There are several types of evidence that teachers* marks 
have been inaccurate. Probably no one who has had several 
years or more of schooling will have any difficulty in calling 
to mind teachers who were known as "hard" or "easy" 
markers. We know full well that an examination paper in 
geometry marked 95 by one teacher, might be marked 65 
by another. In fact, such a paper was, for the sake of the 
experiment, graded by 116 different teachers. One-third 
of them marked it at from 27 to 65, one-third between 65 
and 75, while the remaining third of the teachers assigned 
to this paper marks ranging from 75 to 91. The extreme 
marks given to this paper were 27 and 91. 

Again, in almost any high school it will be found that 
different teachers in the same department will give the same 
pupils totally different marks, one teacher giving many C's 
and D's with very few or no A's, while another teacher in 
the department will give all or nearly all A's, with very 
few C's or D's. In short, teachers' marks represent a 
subjective estimate of pupils' achievement. What is needed 

1 
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is an objective measure of such achievement. In other 
words, a mark is desired which will reflect the quality of 
the object, that is, the examination paper or the pupil's per- 
formance. The teacher's mark is determined not only by 
this object, but also in a large measure by the subject — ^the 
personality of the teacher. 

There are several reasons why teachers' marks are in- 
accurate. In the first place, the teacher either makes no 
attempt, or fails in the attempt, to estimate the relative value 
of the questions of an examination, but merely assigns a 
value of, say, 10 per cent to each of ten questions, or 4 per 
cent to each of twenty-five words in spelling. As a matter 
of fact, one question or one word may be ten times as 
difficult as another. Whenever experiments have been con- 
ducted in which teachers have attempted to judge the dif- 
ficulty of examination questions, their judgment has been 
found to be very unreliable. The result is that the score 
of the pupil who solves the more difficult problems is not 
a fair statement of his ability or achievement as compared 
with the scores attained by other pupils on the easier prob- 
lems. We have no unit of measurement in such a case. 
The ten points received by one pupil may mean something 
entirely different from the ten points earned by another 
pupil on a different exercise. It is as if different grocers 
had different scales, so that a pound of sugar from one 
store would contain three ounces, from another store five 
ounces, from another twelve, and from still another twenty. 

Another objection to the teacher's mark is that the rate 
at which pupils work, or the time required, is not measured. 
Usually a very long period is given for an examination. The 
bright pupil will not be occupied during the entire time. 
His ability has not been measured. Results are therefore 
not comparable. The same score may represent totally dif- 
ferent performances. In one case a score of fifty may mean 
five exercises correctly done in thirty minutes; in another 
case it may mean five exercises completed in two hours. Two 
pupils may get the same score, yet differ widely in ability. 
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Moreover, the traditional examination and its mark do 
not afford the teacher any means of interpreting the mark. 
The teacher has no standard or normal performance with 
which to compare the achievement of the pupil. No teacher 
of shorthand has hitherto been able to state as a fact : "My 
class averages so many per cent above (or below) classes in 
other schools throughout the country, in ability to read short- 
hand notes." We have had no suitable standards with which 
to compare our results. It is now possible for an elementary 
school teacher to say of a boy in her class: "He is just so 
many per cent above the average boy of his age in the 
United States in his ability in spelling." The same may 
be done for handwriting, arithmetic, and other school sub- 
jects for which standard tests or scaled have been con- 
structed. 

It is the purpose of this investigation to construct tests 
for Gregg Shorthand which will be free from the objec- 
tions to the traditional type of examination, and at the same 
time accomplish other desirable results which will be dis- 
cussed hereafter. The advent of similar tests and scales in 
other subjects has given an impulse to experimentation in 
education. This has resulted in better teaching. When- 
ever an adequate test is developed for any school 
subject, the teaching of that subject is inevitably im- 
proved. It is true that after the test has revealed its facts, 
the teaching problem is still to be solved and the work of 
teaching still to be done. But without the facts which the 
standard test reveals, a very important incentive, and in 
some cases important suggestions, for better teaching 
methods are lacking. The standardized test is therefore 
an instnmient which shorthand education can no longer 
afford to neglect. Experimentation in methods of teaching 
must await measures of the results of teaching. 

The necessity of constructing standard tests for the various 
school subjects, including shorthand, is stated by Thomdike 
as follows: "What makes quantitative work in education 
hard is that it deals with facts of human nature and behavior. 
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Complexity, variability, and the absence of proper units and 
scales of measure are the three great difficulties. . . . The 
complexity must be endured, the variability can be overcome 
by modem statistical technique, and the lack of units and 
scales is to be remedied by special investigations."* 

We could have no sciences such as physics, chemistry, 
astronomy or geography if we did not have such measures 
as those of weight, length, area, volume, and temperature. 
Just so we can never have a science of education unless 
we can measure educational facts. Without measures edu- 
cation is a happy-go-lucky, hit-or-miss process. It may 
accomplish much good work, but it can never accomplish 
the best possible work until we can say in education, "I 
know," not, "I think." We have measures which make 
it possible for us to know how much heavier or taller one 
boy is than another, even though one be in San Francisco 
and the other in New York. It is important to be able to 
know also how much faster or better the one writes short- 
hand than the other. For science and progress always wait 
upon measurement. 

Still other values of standard tests should be mentioned. 
Diagnostic tests will serve to point out specific deficiencies 
or educational ailments, for which it becomes the duty of 
the teacher to prescribe and administer a remedy. Indeed, 
the giving of the test will ofttimes suggest the remedy to 
apply. Two forms of a test may be used, before and after 
a given period of experimentation with different methods 
of teaching, in order to ascertain which of the methods has 
produced the better results. Again, the standard test often 
helps to motivate work and secure interest. Pupils will 
accept the scores they make as just and fair. They will set 
to work to surpass their own past records. Many pupils 
do not take teachers' marks seriously, knowing full well 
that a mark may reflect the teacher's dyspeptic condition 
or excessively lenient good-nature. The standard test score, 



* "Quantitative Investigations in £du cation." Sch. Rev. Monogr^h. No. x. 
Pp. 35 and 36. 
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however, is not only recognized as just and fair, but has 
the added interest that comes from knowing what pupils 
in other schools are doing. Furthermore, the standard test, 
such as the scale for quality of shorthand penmanship, 
makes it possible for the pupil to measure his own achieve- 
ment and progress. Knowledge of success makes for suc- 
cess. The teacher has a similar satisfaction and incentive 
in judging her work by comparing her class medians with 
standard scores. In these and other wa3rs standard tests 
should make for the improvement of the teaching of short- 
hand. 

In entering upon this investigation it was recognized at 
the outset that the use of shorthand is a complex process, 
involving mental and motor aspects — knowledges and skills. 
An attempt was made to analyze shorthand into its important 
components and to plan for the measurement of these isolated 
functions. It seemed that shorthand is made up of a 
number of processes, indicated by the questions that one 
would wish to ask with regard to a pupil whose ability in 
shorthand one desired to know. These questions appear to be 
four in number: 1. Can he read his notes? 2. How rapidly 
can he write? 3. How well does he write, or what is the 
quality of his notes? 4. Does he know the system — how 
to write the outlines? In other words, the.important factors 
which one would wish to measure are 1. reading ability, 
2. quality of writing, 3. speed of writing, and 4. knowledge 
of the system as presented in the text-book. This analysis 
has determined the plan of the investigation. A reference 
to the table of contents will show that the sections of this 
study are attempts to provide measures which will enable 
one to answer these questions. 

It is realized that to undertake to construct such a variety 
of tests and scales as seems to be required is to attempt 
a rather ambitious program. It is hoped that some part, at 
least, of the work shall attain to success, and that from the 
whole undertaking, some good may flow. 

Not much attention will be given in this study to the 
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methods of administering tests, or to statistical and graphical 
methods. Those who may wish to use the tests are referred 
to standard handbooks mentioned in the bibliography for 
answers to general questions of this sort 

Nor will this investigation touch the question of prog- 
nostic tests for shorthand. It appears to the writer to be 
probable that certain standard tests now in existence will, 
in combination, serve that purpose well. A pupil who writes 
a good "hand" will probably write legible notes. A hand- 
writing scale may be used. A pupil who spells well will 
probably be able to spell well in a somewhat different system 
(phonetically), and will therefore succeed well so far as 
knowledge of the system is concerned. A spelling test may 
be used. Other factors involved, and for which tests are 
available, are ability to read rapidly, to remember and to 
associate symbols and make these associations automatic. 
The shorthand writer must be able to read notes, associate 
the shorthand symbols with the letters of the alphabet, and 
remember the word-signs and forms for words. The writer 
would predict success in shorthand for one who makes good 
scores on these five tests: handwriting, spelling, reading, 
association and memory.'*' 



*The writer has recently published a Prognostic Test for Stenographic Abil- 
ity. This test includes seven elements as follows: motor reaction, speed of 
writing, quality of writing, speed of reading, menK>ry, spelling, and symbols. 

See also: Bills, M. A., Methods for the Selection of Comptometer Operators 
and Stenographers. J. of A. Psych. Sept., 1921, pp. 27<-286. Also: A Test 
for Use in the Selection of Stenographers. J. of A. Psych. Dec., 1921, pp. 
373-377. 



II. THE CONSTRUCTION OF A SCALE FOR THE 
MEASUREMENT OF ABILITY TO READ 

SHORTHAND 

When entering upon the problem of constructing some sort 
of test for the measurement of the student's ability to read 
correct shorthand notes, the first impulse was to use some 
of the standardized silent reading tests, simply having them 
printed in shorthand instead of ordinary type. Further 
consideration, however, led to the abandonment of this 
plan, for the reason that it was felt that such a test would 
measure a confusion of two things, rather than merely read- 
ing ability. For the most part such tests require some re- 
sponse from the pupil, and these responses are of some 
unknown degree of difficulty. One could never be sure 
how much of the difficulty experienced by certain pupils 
with such a test would be due to the difficulty of the response 
called for, and how much to the difficulty in reading the 
shorthand notes. Some of the reading tests attempt to 
measure comprehension, usually by asking rather puzzling 
questions about what has been read. These would be, of 
all tests, the most unsuitable for the measurement of ability 
to read shorthand notes. 

In order to eliminate this element of difficulty in making 
the required response, the next suggestion was to use a "simple 
directions" test, printing the directions in shorthand instead 
of ordinary type, and accepting the correct response as an 
evidence of the successful reading of the shorthand. But 
here again investigation showed that such tests were made 
up of directions which were not "simple," that is, the re- 
sponses called for were such as involved some degree of diffi- 
culty. Again one could not be sure just what part of a 
given pupil's failure might be due to the difficulty he ex- 
perienced in understanding the directions and the response 

7 
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required. The pupil might read the shorthand correctly and 
3ret fail to make the response required by the test. 

The ordinary way by which teachers gauge roughly the 
ability of pupils to read their notes is to have them attempt 
to transcribe them on the typewriter, or to call upon them 
to read in class. Sometimes also shorthand readers are used. 
These methods are all good as classroom exercises but are 
not very readily capable of greater refinement or of stand- 
ardization for use as group tests. It is alwa3rs possible, of 
course, to standardize, more or less, the procedure involved 
in testing individuals as to their ability to read perfect short- 
hand notes. But teachers do not have time to go into in- 
dividual testing very extensively. Group tests of reading 
ability are needed. 

The reading of the student's own notes in class is perhaps 
a good classroom exercise, but can hardly be standardized 
as a test of reading ability. The transcribing of his notes 
upon a typewriter is open to a number of objections. The 
notes themselves are not standardized. Usually they are 
of different matter, and always vary in their quality as 
shorthand notes. It is furthermore impossible to say just 
what part of the total time consumed in the transcription 
was spent in reading and what part in typing. The good 
typist might very easily make a better score than the poor 
typist, even though the latter excelled in his ability to read 
shorthand. Finally, pupils very often resort to various 
"cribbing" devices to piece out what they cannot get from 
their notes. 

From all of the foregoing considerations it became evident 
that an atten:^)t should be made to devise a test in such a 
way that the particular thing in question, reading ability, 
would be isolated and measured, in a standardized group test, 
in which comprehension or the difficulty of making the re- 
quired responses should play no part. Accordingly an at- 
tempt was made to devise a test comprised of "simple 
directions" which would be really simple, that is, directions 
which involved zero difficulty. 
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To this end teachers, graduate students and friends were 
asked to contribute questions, exercises or directions, the 
answer or response to which would involve no difficulty, 
that is, would be given correctly by as nearly as possible 
one hundred per cent of all who attempted them. 
After some efforts along this line the attempt was given 
up. It seemed that the exercises either involved some diffi- 
culty or were ridiculous. It might, notwithstanding, be pos- 
sible to devise a shorthand reading test in this way, but the 
suggestion came that it would be in many respects more 
satisfactory to try the completion test method. It was 
along this line that the test A-1 was actually worked out by 
a procedure which we shall now describe. 

Two actual business letters were selected, having a total 
length of exactly five hundred words. In these letters every 
tenth word was underscored to indicate that an alternate 
word was to be supplied with it, from which the person 
tested should choose the correct one. The problem arose 
as to whether the correct word should always be written 
above the incorrect one. This would evidently be unsatis- 
factory. The student would soon discover the order. It 
would be likewise unsatisfactory for the same reason to 
alternate, having now the correct, now the incorrect word 
written above. A purely chance order was required. Ac- 
cordingly a penny was tossed fifty times and the "heads" 
recorded as meaning that the correct word should be placed 
above, while the "tails" meant the reverse order. 

When it was attempted to select the alternate words it 
was discovered that, due to the workings of association paths 
in the mind, the words that suggested themselves were such 
as had some more or less logical connection with the sentence. 
This was just what was not wanted, for it would mean that 
the choices would be "fine" ones, requiring a good deal of 
power of discrimination, or in other words, choices of a 
considerable degree of difficulty. In order, therefore, to 
secure such words as would make the choices of practically 
no difficulty, the Ayres Spelling Scale was resorted to, and 
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the words taken from one of its columns. When each under- 
scored word was supplied with its alternate it became ap- 
parent that in several instances the word chanced to be one 
which would make fairly good "sense," thereby making the 
choice of the right word very difficult Such words were 
discarded and still others taken, further down the column of 
the Spelling Scale, until the choices all appeared to be satis- 
factory. 

In order to ascertain whether these word choices were 
really of approximately zero difficulty, the two letters were 
mimeographed, together with directions, as follows : 
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Read the following business letters and draw a line through 
the incorrect word in each place where a choice of words is 
called for. Accuracy is more important than speed, so don't 
do the work faster than you can do it correctly. 

Dear Mr. Jones: 

We beg to acknowledge receipt of "IJ^g for first annual premium 

on policy No. 28148 thus ^^L+la^ your policy in full force and effect 

at once. j" event of your death during this year the policy 

beside ^ ^^^ ^^ ^"^^ ^^^^ value, less this note. j£ you shotild 
desire to pay this note at any *:^" before its maturity, the same 

will be discounted at w^^^j. rate of 4% per annum for balance of 
year. 

Yqu will find enclosed our "Daily Cost of Insurance*' setting 

fordi ^^ easiest way of meeting such obligations. In order u^ovide 

all 
encourage its method, we will allow 6% discount for understand 

remittances sent us during the year on account of note, thus 

distributing its burden and relieving its strain. 

aI one of our policy-holders you are a member ^ the Cor- 
poration and thus interested with its management in i^?SL,j "p its 
membership. In 1915 our business was considerably .^« advance 
of the year 1914, and we are anxious J^it make the current year 
a still better one. This ^Uj^ no doubt be done, but it will be much 

easier ^^^ "^ *^ ^^ ** *^ ^^^ ^^^ policy UQijg^s ^^^ contribute their 
share in the way of interesting *J^f|J*^ friends and in the way of 
securing their applications. 

1^ we not have you with us in this good ^^^ ? Every new 

policy-holder will contribute to the greater ^i}^j of the Fund, and 

therefore to its surplus accumulations, ^ « thus to larger dividends. 

This incentive for your sympathetic !!j5^*. active co-operation is 
therefore worthy of your consideration. 
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Wishing ^^^^^^ all success in every effort to advance the welfare 

while ^^ ^^* ^^ *^^ 

Very sincerely yours, 

Washington Mutual ^^ 

Dear Snt: 

We are in receipt of your letter ^?* _^ recent date in which you 

recover 

ask us to send ".^l^*^**^ suid terms on the Smithton Typewriter. 
Following are our -^f^^f to district agents whom we expect will 
appoint sub-agents ^^^ well as sell direct : 

The Smithton Typewriter is retailing ^^^ $75. Our price to 
agents is $50 Smithton. If '^^ accompanies the order a discount 
of 2% will be ^e^n ^^ guarantee our machine for a period 
of one ^ against imperfect parts or mechanical construction and 
will stand ^^^ of all sales you make. 

We are inclosing an afJ^Qct ^^^^^^ ®^ instructions to users 
of our machine and ^J^^nfr *^P*^*te cover mailing one of our 
dealers instruction booklets, ry ^^^ ^^ *^ become our repre- 
sentative in your district ^^^ will ask you to outline by counties the 
territory ^^ wish to cover. 

With your first order we will *J?!f some illustrated folders 
and also some advertising cuts if 7^^ intend to do local newspaper 
advertising. We will do gyfjlljlu-ng possible to help you get busi- 
ness. We are in ^giti^ *^ ^^^ orders on twenty- four hours' notice 

hnth 

and will . a preference to our American agents. Hoping to hear 
heart ^^" further if interested, we beg to remain, 

Respectfully X"" 
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In this form the test was given to forty-four boys in the 
commercial department of the Frederick, Maryland, Boys' 
High School, and to forty-six girls in the Junior class of 
Hood College. The papers were subsequently scored. It 
was found that the girls made the wrong choice in six-tenths 
of one per cent of the cases, while the boys made the wrong 
choice in three and one-fourth per cent of the cases. Of 
71 errors made by the boys, 36 were on three on the choices : 
"to-provide," "real-fund" and "file-forth." Of 15 errors 
made by the girls, 1 1 were on these same three choices. It ap- 
pears that in all three cases the words form a "phrase," which 
fact made the choice confusing. The three difficult choices 
were therefore changed by supplying other alternate words, 
such as would avoid this confusion. With this change it 
appears that the test, as printed in ordinary type, would in- 
volve certainly less than two per cent of difficulty, and in 
the case of the girls, less than one-half of one per cent of 
difficulty. This seemed to be a satisfactorily close approach 
to zero difficulty, and accordingly the test was now printed 
in shorthand, with only the word choices in ordinary type. 
This test is known as "Test A-1, Reading Ability." 

By the opening of the school year of 1921-22 the author 
was able to report tentative standard scores on this test, 
based on 233 cases in 16 different classes in 12 different 
states, as follows: 

For those who had one year of instruction in short- 
hand, a median score of 67. 

For those who had two years of instruction in short- 
hand, a median score of 80. 

Two other business letters, from the same firms, dictated 
by the same men, and therefore probably of approximately 
the same style and difficulty, are at hand, for the construction 
of a second form of the A test. But the publishing and 
standardizing of a second form has been postponed until 
further use of the first form shall have fully justified its 
validity for its purpose. 

It should be noted in passing that the directions given 
with the preliminary testing: "Draw a line through the 



14 THE ABILITY TO READ SHORTHAND 

incorrect word" were changed on the A-1 test to: "under- 
score the correct word." One person who tried the pre- 
liminary test reported that the required turning of the atten- 
tion to the incorrect word led to some confusion, and that 
it would be easier to check the correct word. The objection 
seemed well-grounded and the change was made. 

Further use of this test with a larger number of pupils, 
492 in all, distributed in 33 classes in 17 states, shows 
somewhat lower standard scores, which appear in the fol- 
lowing table : 




THE ABILITY TO READ SHORTHAND 



15 



TABLE I 
Distribution of Scores, and Standard Medians of A-1 Test 
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III. THE CONSTRUCTION OF A SCALE FOR 
SPEED OF WRITING IN SHORTHAND 

The usual way in which teachers of shorthand attempt 
to measure the speed of writing of their pupils is by dictat- 
ing certain material to the class, gradually increasing the 
rate of reading until they can barely succeed in "taking" it 
This method is open to several objections. In the first place, 
it presupposes a "class," whereas in reality there is no such 
thing as a class. No two in the class can write at exactly 
the same rate of ^)eed, except by a very remote chance, and 
yet this test presupposes that a group will be able to take 
the dictation at a given rate. The method would be more 
valid if applied to an individual, and even then the teacher 
should be in a position to see the pupil's notes, so as to know 
whether the pupil was "keeping after." Otherwise, if the 
dictation were too rapid, the pupil would be embarrassed and 
confused by the necessity of remembering the part dictated 
but not yet written, and the tendency would be cumulative in 
the direction of a decrease of efficiency, even below the real 
ability of the pupil. 

The method is further open to the objection that the 
material dictated is not standardized. Its difficulty is not 
known. The writer has seen classes struggling and growing 
discouraged, (a condition which is opposed to improvement) 
when they came upon a difficult section of their dictation 
book, made up of materials in "heavy" language, perhaps 
more or less technical. Being accustomed to write 100 words 
per minute, they now failed to maintain this speed, and were 
perhaps chided by the teacher for their failure to do what 
they should never have been expected to do. It would be 
well if even the dictation practice exercises were standard- 
ized, so that in all cases pupils and teachers might know what 
might reasonably be expected of them at their stage of ad- 
vancement. But certainly tests should be on standardized 
materials. 

16 
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In an effort to meet the first objection, teachers have 
sometimes given the class a passage in longhand, and asked 
them to transcribe it into shorthand. This may be a legiti- 
mate classroom procedure, but as a test it is in turn open 
to some objections. What does it test? Evidently reading 
ability and knowledge of the shorthand system as well as 
speed of writing. This ability and this knowledge are im- 
portant, and well worthy of being tested or measured. But 
there is a time and place for everything. Certainly a good 
test will not attempt to measure a number of different 
things at the same time. 

The problem then is: how may a test be constructed to 
measure the pupil's ability to write shorthand rapidly, such 
that it will allow each pupil to work at his own rate of 
speed (he should not be confused by being compelled to 
write faster than he is able, nor should he find time hanging 
heavy upon his hands because the dictation is too slow to 
call forth the best speed that is in him), will employ standard 
materials of known difficulty, and will afford standard scores 
for comparison? 

To supply a standardized passage in ordinary t3rpe with 
directions that it be copied in shorthand is open to the objec- 
tion that so much depends upon the pupil's knowledge of the 
system. Furthermore, much time would be consumed in 
looking back and forth, from the copy to the line of writing. 
One who knew the system well and could look back and forth 
readily without losing his place might win the highest score 
in such a test, even though he actually drew his outlines 
very slowly instead of really writing them. If the standard- 
ized passage were supplied in shorthand, with directions 
merely to copy it, the objections would be that the pupil must 
still look back and forth, hunting his place, and that further- 
more much time may be lost in the attempt to read the short- 
hand, for one can not write shorthand readily unless one 
knows the words and the letters he is writing. 

It seemed, therefore, that the pupil should be supplied with 
the longhand of the passage to prevent his losing time in 



18 SPEED OF WRITING IN SHORTHAND 

reading; that he should be supplied with the shorthand of 
the passage to prevent his gaining or losing anything in his 
"speed of writing" score by virtue of his superior or inferior 
knowledge of the system; and that both the longhand and 
the shorthand should be given him as he goes, at the rate 
of speed which just suits him, in such a way that he would 
not be compelled to look back and fortfi, hunting his place 
in the copy. These considerations suggested, what has been 
called, "the tri-interlinear device" of the tests B-1 and B-2, 
for speed of writing. It will be noticed that tfiese tests pro- 
vide three lines, one for the longhand, one for the short- 
hand, and a line of writing for the pupil's own notes. It is 
believed that these tests will more nearly isolate the function 
it is here desired to measure, speed of writing shorthand 
notes, than will any other sort of test that has been devised. 
One's eyesight is less taxed, not being required to find the 
place in the copy. Nothing depends upon one's hearing, 
as in the case of matter dictated. One's score is not much 
affected by one's knowledge of the system, for the proper 
shorthand outlines are indeed "at his pencil's end," supplied 
in the test. Nothing depends upon memory, as in the case 
of a test dictated to a group. The writer has known cases 
where the inferior pupil came out ahead in such tests, simply 
because when the dictation oime too fast they had the ability 
to store up much of it in memory, to write it later when 
the dictation was slower or had ceased. This, of course, 
is a very valuable ability for the practical stenographer, and 
should be cultivated if possible. But it should not be allowed 
to intrude when the purpose is to measure speed of writing, 
isolated from everything else, or as nearly isolated as may 
be possible. 

Copies of the tests, keys, and class record sheets are given 
in the appendix. They include the necessary directions for 
giving and scoring the tests. It will be noted that by means 
of the key supplied to teachers, the tests may be scored in 
a very small fraction of a minute. In fact, the teacher might 
score the papers for a large class in less than five minutes. 
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This IS one great advantage of these tests. The resulting 
"pupil's score" is a score in words written per minute. 

It has been reported to the writer that the fastest living 
writer of Gregg Shorthand tried these tests and found that 
he could not complete their four hundred words, or more, 
in the allotted time, two minutes, even though he could ordi- 
narily "take" the same amount of material in dictation in 
less than two minutes. The obvious reply is that we are 
not claiming for these tests that they will give the same 
score that some other form of test will yield. The scores 
in dictation tests will probably be higher. All that need be 
claimed to establish the validity of these tests is that the 
relative scores of two or more persons who take the tests 
give a true idea of their relative ability so far as speed of 
writing is concerned. If they do this as well as other sorts 
of tests do, and in addition supply standard scores, they 
have at least that advantage to their credit. That no one 
can complete the tests in the time allowed is not at all dis- 
concerting, but rather most gratifying. It was the purpose 
to provide more material than any one could finish. Other- 
wise those who finished before "time" was called would not 
have been tested. 

Tentative standard scores were published in September, 
1921, for the B-1 and B-2 tests as follows: 

B-i B-a 

Number of cases 281 265 

Number of classes tested 17 15 

Number of states represented 11 11 

Median for those who had shorthand 1 yr 55.9 69.1 

For those who had shorthand 2 years 73 80.5 

Further use of these tests with a larger number of cases, 
984 in all, distributed through 32 classes in 15 states for 
B-1 and 29 classes in 16 states for B-2, yielded the median 
or standard scores shown in the following table : 
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TABLE II 
Distribution of Scores, and Medians of Tests B-1 and B-2 
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Tentative standard scores for. the two forms of the B tests 
seem, at first sight, to indicate that B-2 is less difficult than 
B-1, inasmuch as the norms set for the two forms are ap- 
proximately ten points higher for B-2 than for B-1. It 
would, of course, be very unfortunate if two forms of any 
test diflFered so widely in difficulty. The two selections 
were made with a view to having them of approximately 
equal difficulty. They were taken from the same writing, 
and appear to be similar in style. 

Fortunately, there was evidence to show that in all the 
cases upon which these tentative norms were based, B-1 was 
given first, and B-2 second. There was a possibility, there- 
fore, that the diflFerence of ten points might be due to the 
eflFect of practice, especially in view of the fact that the 
test is quite diflFerent in its nature from anything the stu- 
dents were likely to have done before. Accordingly when 
the two forms of the B test were given to the ninety-six 
cases, as described elsewhere, they were given in the reverse 
order: B-2 before B-1. The result was that the median 
score for B-1 was found to be, not lower, but actually six 
points higher than the B-2 median. The practice-effect may 
have been more or less in this case than in other places. 
Taking these results as typical, however, they would indi- 
cate a diflFerence in difficulty of only two points — an almost 
negligible diflFerence. It is recommended that those using 
the tests should read the norms given for B-1 as the standards 
for the first use of a B test, and similarly for the norms 
given for B-2. 



IV. THE VALIDITY AND RELIABILITY OF THE 

A AND B TESTS 

Two questions which should be asked with r^[ard to every 
test are: 1. Is it valid? 2. Is it reliable? In other words, 
the first question is whether the test measures the function 
it pretends to measure; the second question asks whether 
the test or the different forms of the test measure that func- 
tion consistently. A test may be very interesting and very 
cleverly arranged, yet really useless if it does not measure 
the function it is intended to measure. Again, a test is com- 
paratively worthless if it gives widely diflFering results on 
two or more successive applications. In that case we say 
it is not trustworthy, or not reliable. It is incumbent 
upon anyone who offers tests to teachers for their use to 
inform them as to the extent to which the tests may be 
trusted to do the thing they are said to do, and to do it con- 
sistently. To answer these questions a number of investiga- 
tions have been made. 

The Validity of Test A-1 
In searching about for an absolute measure of reading 
ability, with which the results of the A test might be com- 
pared, so as to show its measure of validity, the author 
decided upon the plan of giving individual, timed tests in 
reading. An arrangement was made with the Boys' High 
School, Frederick, Md., whereby the boys of the Commercial 
Department were permitted to come to the office, one at a 
time. The writer met each boy, explained to him the purpose 
of the work, and the fact that the results would not affect 
him in any way, thus trying to get the best possible rapport. 
The boy was then requested to begin reading aloud from a 
page of printed shorthand notes (Gregg Speed Studies, page 
156, "Productive Employment"). Each reading was care- 
fully timed with a stop-watch for three minutes, and the 
number of the last word read was recorded. This number 
was regarded as a gross result, from which the number of 
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words "prompted" was subtracted to get the net number 
of words read. In prompting, the experimenter allowed 
exactly five seconds, in every case, before giving the help. 
The net number of words read was divided by the number 
of minutes (three) to get the net number of words read 
per minute. These scores were considered sufficiently reliable 
measures of the pupils' reading ability to justify their being 
adopted as a criterion. 

Test A-1 was then used with this same group of boys, 
and after an interval of a week, used a second time. These 
two sets of scores were averaged and the average scores 
correlated with the individual-timed reading scores. The 
resulting coefficient of correlation, using the Pearson for- 
mula, was .55, P. E. .08. The correlation with the first use 
of A-1 yields a somewhat lower coefficient, while with the 
second use of A-1 the coefficient of correlation is somewhat 
higher than that given. Furthermore, two or three of the 
brighter boys tried to "beat" the test the second time they 
took it, by guessing at the word-choices, thus trying to 
accomplish a greater part of the work than they could other- 
wise do. Their guesses proved rather unfortunate. Inas- 
much as the method of scoring the test calls for subtracting 
the number wrong from the number right, these boys received 
very low scores — ^much lower than on the first trial of the 
test, when they followed directions honestly. If these scores 
were left out of account, the coefficients of correlation would 
be nearly ten points higher, that is, approximately .65 with 
a correspondingly lower P. E. However, even the obtained 
coefficient, .55, is regarded as satisfactory evidence of the 
validity of the t^st. This statement needs to be qualified, 
however, by a recognition of the fact that the number of 
cases was perhaps too small (forty-one cases) to be conclu- 
sive. 

The Reliability of the A Tests 

As mentioned above, test A-1 was used twice with the 
group of forty-one boys, with approximately one week 
intervening between the two uses of the test. These two 
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sets of scores were correlated to show the extent to which 
the test is reliable, or consistent, in yielding the same sort 
of results on successive trials. The self-correlation of test 
A-1 was found to be that expressed by the Pearson coefficient 
.80, P. E. .04. This coefficient seems quite satisfactory, 
though here again it needs to be remembered that the num- 
ber of cases was rather small. 

The author's experience in the use and the scoring of the 
A-1 test indicates that while the results secured from the 
first use of the test are good, the second use of the same test 
yields somewhat better and more reliable scores. This ap- 
pears to be due to the fact that the nature of test is "strange" 
to the pupils. On the second trial they get the "swing" of 
it and do themselves justice. The same remarks apply with 
equal force to the B tests. Experience with the results in 
those cases where pupils, knowing the author personally, 
tried to "beat" his test by guessing at the word-choices, 
justifies those who use the test in warning the class that 
the test and its scoring are such that "the cards are stacked" 
against those who guess. The chances are that they will 
make better scores by honest work than by guessing. Teach- 
ers can very readily tell when guessing has been resorted to. 
Given the context, the word-choices are of approximately 
zero difficulty. Honest papers usually show no mistaken 
choices, so far as they go. Or at most, they may show one 
or two mistaken choices. When pupils guess they will have 
a much larger and very noticeable number of mistakes. 

The Validity of the B Tests 

Miss Brewington of the University of Chicago gave a 
group of thirty-four pupils two forms of the B test To 
the same group was assigned the task of copying familiar 
printed shorthand from a page of a text-book for three 
minutes. All scores were reduced to a words-per-minute 
basis. The B-1 and B-2 scores were averaged, and the 
average scores correlated with the scores derived from the 
timed readings from good, printed shorthand notes. The 
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Pearson coefficient of correlation was found to be .51 with 
a P. E. of .09. The correlations with either of the B tests 
alone were approximately the same. This coefficient is worthy 
of some consideration as showing the validity of the tests, 
though the number of cases must be admitted to be too 
small. 

A similar experiment was made in the High Schools of 
Frederick, Md. Ninety-six pupils were given the two forms 
of the B test. They were also given an original test, which 
may be described as follows: A selection of fifty words 
from "Rip Van Winkle" was written on the blackboard in 
good shorthand notes. 

"He was observed at first to vary on some points every time 
he told it, which was doubtless owing to his having so re- 
cently awaked. It at last settled down precisely to the tale I 
have related; and not a man, woman, or child in the neigh- 
borhood but knew it." 

The teachers then read the shorthand to the class and 
had them copy it three times for practice and to familiarize 
them with the text and the outline. Practice papers were 
then laid aside and the pupils were told to write the matter 
as often and as rapidly as they could, for three minutes. 
The teachers gave the signals "start" and "stop" and kept 
the time carefully. Papers were then collected and scored, 
in words per minute. 

The correlation of the scores on this original test with 
the average scores made on the two forms of the B test yields 
the coefficient .73 P. E. .03. This coefficient is regarded as 
quite satisfactory and the number of cases as fairly large. 
These results tend to show the validity of the B tests. Taken 
together with the results secured by Miss Brewington, they 
show that the B tests will give, in a few minutes, scores very 
similar to those derived from other, unstandardized tests 
devised with a view to measuring the same function, speed 
of writing. The B tests have the advantage of being more 
convenient, requiring less time to administer and score, and 
affording standard scores for comparative purposes. 
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The Reliability of the B Tests 

Scores received from Miss Brewington on the two forms 
of the B test for fifty-seven individuals, show a self-corre- 
lation expressed by the Pearson coefficient .83 with a P. E. 
of .03. 

Self -correlation of the ninety-six scores on the two forms 
of the B test administered in the Frederick High Schools 
is found to be .87, P. E. .02. 

Here we have a fairly large number of cases (one hundred 
and fifty-three in all) and a close agreement between the 
two coefficients, tending to show that the true d^ree of self- 
correlation will probably be found to be between .80 and .90, 
or at any rate, high enough to justify the B tests from the 
standpoint of their reliability. 

TABLE III 
Coefficients of Correlation Showing Validity and Reliability 

OF THE A AND B TeSTS 
Scores Correlated No. casea r P. E. 

Average of two scores on A-1 with stop- 
watch-timed individual test 41 .55 .08 

Self-correlation of A-1 41 .80 .04 

Average of B-1 and B-2 with copying from 

text-book 3 min. (Chicago) 34 .51 .09 

Average of B-1 and B-2 with writing famil- 
iar text 3 min. (Frederick) 96 .7Z .03 

B-1 with B-2 (Chicago) 57 .83 .03 

B-1 with B-2 (Frederick) 96 .87 .02 



V. THE CONSTRUCTION OF A SCALE FOR 
SHORTHAND PENMANSHIP 

For the purpose of constructing a scale for the measure- 
ment of the quality of Gregg Shorthand penmanship, a col- 
lection of specimens of shorthand was made in a uniform 
way. From "The Legend of Sleepy Hollow" and "Rip 
Van Winkle," both from Irving's "Sketch Book," two hun- 
dred and fifty-four selections were made, of exactly fifty 
words each. These selections were cut from the books and 
glued upon cards three by six inches in size, both in the 
shorthand and in the longhand. These cards were distributed 
to pupils in various schools, together with a sheet five 
and one-half by eight and one-half inches, upon which were 
printed the outlines of two squares, three by three and 
one-half inches each, together with the directions: 

"Number (Write here the number given on 

the card.) Copy the shorthand given on the card in the 
upper space first, then again in the second space." 

The purpose was to regard the first writing as practice, 
and to use the second in the actual construction of the scale. 
Most of the cards were copied by four different individuals. 
By means of the ntunber at the top of the page each specimen 
can be identified, and by turning to the card with the cor- 
responding ntunber, the key to the shorthand may be found. 

Teachers were instructed to allow pupils to use either pen 
or pencil and to allow them sufficient time so that all might 
finish. They were also instructed to secure specimens from 
all pupils, regardless of the degree of proficiency or advance- 
ment in shorthand. 

In this way eleven hundred and fifty-five specimens were 
secured. The names of the schools and the number of 
specimens secured from each are as follows: 

Western High School, Baltimore, 615; High School of Commerce, 
New York, 165; Schenley High School, Pittsburgh, 96; The Balti- 
more Business College, 79; Baltimore City College, 25; Girls' High 
School, Frederick, Md., 50; Boys' High School, Frederick, Md., 42; 
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The Harrisburg (Pa.) Shorthand School, 28; The Lancaster (Pa.) 
Basiness College, 26; individuals, 3; The Gregg Publishing Com- 
r, 6; Jc^ins Hopkins University, Summer Session, 20. 



The six specimens secured from the Gregg office were 
written by experts. The twenty specimens secured in the 
University Summer Session were written by persons, none 
of whom had ever had any instruction in shorthand whatso- 
ever. These twenty-six specimens were secured in this way 
after it had been found that the more than eleven hundred 
specimens contained few if any that were good enough for 
the upper end of the scale, or poor enough for the lower end. 

The entire eleven hundred and fifty-five specimens were 
graded by five judges. The judges were told to sort the 
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specimens into five piles, very good, good, medium, poor, 
and very poor, in such a way that approximately one-half 
of the entire number would be in the middle or medium 
group, about forty specimens each in the very good and 
very poor groups, with the rest about equally divided between 
the good and the poor. In other words, a normal distribu- 
tion was assumed, with the percentages for the five groups 
approximately three, twenty-two, fifty, twenty-two and three. 
It was felt that this would assist the judges in giving a 
better rating than would probably be the case without such 
guidance. 
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The five judgments on each specimen were then averaged 
and on this basis a selection was made of approximately 
forty-one specimens of each grade, very good, good, medium, 
poor and very poor. This meant that in all only two hun- 
dred and five specimens were retained for further grading, 
while the great bulk, nine hundred and fifty specimens, repre- 
senting a surplus of material at about the middle part of 
the scale, could be at once discarded. It was believed that the 
two hundred and five specimens, so selected, would include 
an adequate number for each step of the scale. (See figure 3.) 

Twelve additional judgments were then secured for the 
two hundred and five specimens, in accordance with the 
following directions : 

Directions FOfR Grading 205 Specimens of Shorthand 
Preliminary — Shu£9e thoroughly like cards. 

I 

Sort the 205 ^Kcimens into five piles (A, B, C, D, E, or Very 
Good, Good, Medium, Poor, Very Poor) so that there are not less 
than 34 nor more than 44 in any one pile. If there are more or less 
than these numbers in any pile, re-sort the larger piles at least in 
part 

II 

Re-sort each of the fiye inles into two, so that you get the better 
and the worse halves, with not over 25 or under 15 in each half. This 
step will give you ten inles, from the worst, which we will arbitrarily 
call 1, to the best which we will call 10. 

Ill 
Turn each of the ten inles over and write on the back of each 
paper, under the numbers already there, at the left hand edge, its 
score (i. c, 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10). SHUFFLE. 

Here the assumption was that there were approximately 
an equal ntunber of specimens representing each of the five 
groups. For this reason the directions were given for the 
guidance of the judges in such a way as to rule out of ac- 
count their personal opinions as to the absolute quality of 
the specimens. What was wanted was their judgment as to 
the relative qualities of the specimens. 

There were now five and twelve, or in all seventeen, judg- 
ments recorded for each specimen. With the aid of an add- 
ing machine these seventeen judgments were averaged, count- 
ing the digits as tens (thus 6 would count as 60,) and 
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counting the values of the five groups of the original judg- 
ments as 90, 70, 50, 30 and 10. The values of the two hun- 
dred and five specimens, secured by thus adding their points, 
were then arranged in order from the best to the worst 

From the two hundred and five specimens, so evaluated, 
forty specimens were now selected, such that their point 
values differed by approximately equal amounts. By this 
procedure it was believed that a series of specimens was 
secured, ranging, by approximately equal steps in value, 
from the very poorest, of approximately zero value, to the 
very best, a specimen of perfect shorthand, written by an 
expert, the value of which is approximately one hundred. 

These forty specimens were then engraved (see appendix) 
and five hundred and fifty duplicate sets struck off, which 
were mailed to as many different teachers of shorthand all 
over the United States, with the request that they judge them 
in accordance with the following directions: 

To Gregg Shorthand Teachers : 

For nearly two years I have been working on a scale for measar- 
ing the quality of Shorthand Penmanship. Now I have reached the 
stage in my work when I must send this appeal for co-operation to 
500 teachers of Gregg Shorthand. 

Some time in January the completed scale will be ready. A copy 
will be sent you gratis in return for your co-operation. 

I wish to have the 40 specimens sent you herewith graded from the 
standpoint of their quality or general merit as shorthand penmanship. 
Will you please co-operate with me in this work by giving me the 
benefit of your judgment? 

The Following Plan is Suggested: 

1. Sort the forty specimens into five groups of about eight speci- 
mens each, as follows : VERY POOR, POOR, MEDIUM, GOOD, 
VERY GOOD. 

2. Now take each of these groups in turn and divide it into the 
better and worse halves. This will give you ten groups of four speci- 
mens each. 

3. Take up one group after the other and arrange the four speci- 
mens from the standpoint of their merit as shorthsmd penmanship. 

4. When you have gone through each group in this way you will 
have arranged the entire forty specimens in such a manner that the 
best is on the top and the worst at the bottom, with the others gradu- 
ated all the way between. 

5. Put the specimens, arranged in this order from best to worst, 
in the return envelope, and post. 
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May I assure you your co-operation in this matter will be greatly 
appreciated. Sincerely yours, 

(Signed) 

When the time arrived that the judgments should be in 
hand, it was found that 250 teachers had responded by 
arranging the specimens in the order of their quality from 
the best to the worst, and returning them in this order. 
A considerable number of judges reported less promptly. 
Fifty of these were later included in the study, making 300 
in all. The resulting data are given in a tablef in which 
the judges are indicated by the numbers at the left hand 
margin, from 1 to 300, and the ranks by the numbers at the 

TABLE IV 
Average Rank of 40 Specimens of Shorthand 

No. of Specimen Average Rank No. of Specimen Average Rank 

4 20.408 
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32* 


3.164 


23* 


4260 


24* 


6.104 


27* 


6.988 


28* 


9282 


26 


10.728 


17 


10.960 


38* 


11.052 


3 


12.152 


2 


12.592 


13* 


13.744 


15 


14.512 


12 


15.392 


34* 


15.692 


20 


16.768 


18 


17.072 


30 


17.912 


22 


17.964 


33* 


18.760 



10 20.672 

19 20.796 

5 21.148 

9^ 21.180 

Z7 25.484 

36* 25.516 

40 28.020 

8* 29.628 

14 31.156 

25 31.164 

1 32.480 

6* 32.556 

31 32.980 

7 33.464 

39 33.492 

29 34.076 

16 34.220 

35* 34.620 

21* 39.812 



top of the table, from 1 to 40. The main body of the table 
is made up of numbers which identify the several specimens, 
to which the numbers from 1 to 40 were assigned in a purely 
chance order. To illustrate, if judge number 1 considered 
specimen 10 to rank thirteenth, then "10" would be written 
opposite 1 and under 13. 



t This table is not reproduced here. Anyone who ia interested in these mig- 
inal data will find them in the author's dissertation on file in the library of 
the Johns Hopkins University. 

* Indicates the specimens included on the scale. 
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After the results were compiled for the first 250 judges 
to report, the average rank of each of the specimens was 
computed with the aid of a calculating machine. This was 
done in order to ascertain the relative values or ranking of 
the specimens. The result is shown in Table IV. 

The next step was to count the number of judges who 
considered each specimen superior to the next best, and then, 
with the aid of the table given by Thomdike in his "Mental 
and Social Measurements" (pp. 122, 123, Table 23) to ascer- 
tain the differences in the values of the specimens in terms 
of P. E. This method is based upon the theory that "equally 
often noticed differences are equal." The amounts of differ- 
ence are shown in Table V. 

In connection with his explanation of this method Thom- 
dike says: "The method as a whole presupposes that the 
observations are made by judges of some competence. Its 
precision depends upon how competent they are." Some- 
thing needs, therefore, to be said with reference to the 
judges employed in this work. 

When the Gregg Publishing Company called upon teachers 
of shorthand to lend their aid in the construction of short- 
hand scales and tests, about four hundred responded, ex- 
pressing their willingness to try such tests and cooperate in 
their development. This was a very gratifying response, 
and would seem to indicate on the part of these teachers 
some degree of understanding of the nature and value of 
standard measures, as well as a spirit of willingness. Be- 
lieving that no more capable, intelligent, and willing body 
of judges could be found, the writer decided to invite the 
cooperation of these teachers in judging the specimens. 
The 150 additional sets were sent, for the most part, to 
shorthand teachers in the schools of certain large cities, 
notably Baltimore and Los Angeles. A few were sent to 
individuals known to be expert in shorthand. Many expres- 
sions of interest were received from the judges. A number 
reported that the work was difficult. All indications seemed 
to point to the fact that in general the judges performed 
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TABLE V 
Values of the 40 Speciiiems 
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their work in a most careful and intelligent manner. The 
geographical distribution of judges is also quite satisfactory,* 
representing 38 States and Canada. 

Table V gives the values of the 40 specimens of shorthand 
in terms of P. E. From inspection of this table it now be- 
came possible to select specimens in such a way that they 
would differ from one another in value by approximately 
five points, on a scale of 100 points. Thus were selected the 
sixteen specimens whose values appear on Table VI. This 

TABLE VI 
Values of Speciuens Included in Scale 
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13 
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33 
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table should be read as follows: Specimen No. 11 is con- 
sidered better than specimen No. 32 by 218 out of 300 



Monluii, I. Hiine, B, MiuacbuKMh 19, Miuouri. t, Hidiigui, 18, 
I, Mvrland. ir. Ncbraaka, 6, New M«>doa, 1. Nortta Dalcoti. 1, 
ihire, I. New Jener. '3. New Yofk, a6, Ohio, 9, Orcfox. 4. OkU- 
'enniylvanii, to, Rhode Iiland 4. South Dikola, i, Teniuwee, I, 
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judges ; that is, 72.7 per cent of the judges consider it better, 
or 27.3 per cent consider it worse. By reference to the 
table it is found that 27.3 per cent of worse judgments cor- 
responds to a difference in value of .90 P. E. This, added 
to the value of No. 32 (10.51) gives No. 11 a value of 
11.41. In order to raise these values to a scale of 100 points, 
one P. E. is taken to be 8.25 points. All the values as given 
in the seventh column of the table are therefore multiplied 
by 8.25 to get the values in the eighth column. In the case 
of No. 11 this value is 94.13. The nearest whole number is 
94. The value assigned this specimen on the scale is 95. 

Specimen number 21 was written by a person who knew 
nothing of shorthand. It is clearly intended to be shorthand, 
though illegible as such. Its value is assumed to be zero. 

It may, perhaps, be noticed that the values assigned the 
specimens in Table V and Table VI vary somewhat. This fact 
requires an explanation. It is due to die fact that in die 
latter table the specimens are taken, not in die order of their 
rank, but in some of the steps one or more specimens are 
passed over. In the first table specimen 28 is compared 
with 26, and considered superior by 53 per cent of the 
judges. In die latter table 28 is compared with 38, and 
found superior by 61.3 per cent of the judges, making the 
difference in value between 28 and 38 in the latter table. 
.42 P. E., whereas in the former table dieir difference is the 
sum of three steps of difference, .11, .14, and .00, or .25. 

The fact of the existence of these differences might at 
first sight seem to invalidate the method. In reality the facts 
appear to justify the conclusion that the judging has in this 
case been very well done. A comparison of the values 
assigned the specimens in the two tables will show that the 
largest variation is .31 P. E. The fact that this variation 
is so small argues the care and precision with which the 
work of the judges has been done. In any event, the varia- 
tions are so small, as they affect the scale, that diey will 
not mar its practical value. In other words, the differences 
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are so small as probably to fall below the power of human 
discernment. 

The sixteen specimens so selected were finally arranged 
for puUication in the form of a scale, a copy of which, to- 
gether with a copy of the Class Record Sheet prepared for 
use with the same, is included in the appendix. G)pies of 
the scale and record sheets were promptly sent to the three 
hundred teachers and others who had judged the specimens, 
with the request that they use the scale as per directions given 
on the Qass Record Sheet, and report the results on a dupli- 
cate of said sheet. Such reports were secured for 1627 
cases. A study of these results is given in the Tables VII 
and VIII and Figures 4 and 5. 

The graphs indicate a normal distribution of the scores 
for speed, but a very much skewed distribution of scores 
for quality, with a marked tendency to give too many of the 
very high scores, 85, 90, and 95. This is probably due largely 
to the fact that those who have used this scale are for the 
most part persons who have not had previous training in 
the use of a quality scale. It is probable, furthermore, that 
the habit of giving grades of 90 to 95 in high schools, car- 
ries over here in spite of the scale. 

The medium scores for quality (77.4 and 81.5) show 
an improvement of only 5.3 per cent in one year's work, 
whereas the median scores for speed (45.8 and 64.4) show 
an improvement of 46.1 per cent in one year. 
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TABLE VII 

Quality op Pupu^' Shorthand Notbs 
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TABLE VIII 
Speed of Pupo^' Shokthamd Notes 
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Table IX shows the relationship between speed and quality 
of notes for 700 cases, including both first and second year 
pupils. The coefficient of correlation has been found to be 
22 with a P. E. of .02. This may be interpreted as indicat- 
ing that the positive relationship is present, but not in any 
very marked degree. If in our high schools the improvement 
during the second year's work were as great for quality as 
for speed, the degree of relationship would probably be found 
to be considerably higher than that indicated by the co- 
efficient .22. 

TABLE IX 
Relationship Between Speed and Quality of Shorthand Notes 
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Na of cases : 700. 
Coefficient of correlation .22. 
P. E. .02. 



VI. THE CONSTRUCTION OF A SCALE FOR 
KNOWLEDGE OF THE SYSTEM 

How shall the pupil's knowledge of the system of short- 
hand be measured? In the first effort to devise a measure 
for knowledge of the system, a collection was made of such 
questions as teachers of shorthand are accustomed to ask 
on their "examinations." The purpose was to select a few of 
such questions or exercises calling for knowledge of the 
system, and to form preliminary tests from which die diffi- 
culties or values of the several exercises might be ascertained, 
after which such of them as seemed suitable could be made 
into one or more forms of a test for knowledge of the system 
of Gregg Shorthand. After the collection was made, how- 
ever, the result was such a chaos that when an alternate plan 
suggested itself, this original plan was given up. The plan 
adopted appeared to hold out the promise of being, if not 
easier of accomplishment, certainly the more useful of the 
two. 

This second plan was to take the 1,0CX) commonest words 
as given in the Ayres Spelling Scale, make them up into 
preliminary vocabulary tests in shorthand, and from these, 
ascertain the difficulties or values of the 1,0CX) words from 
the standpoint of shorthand writing, which would make it 
possible to arrange these words in a Shorthand Scale, simi- 
lar in style to the spelling scales. 

Further consideration, however, showed the necessity for 
a revision or enlargement of this plan, for it was recog- 
nized that knowledge of shorthand includes die ability to 
write phrases as well as words. For this reason it seemed 
necessary that such a scale should include the values of 
phrases as well as words. Accordingly, the first impulse was 
to include with the 1,0CX) commonest words the approximately 
570 phrases given in the Manual. Investigation showed, 
however, that at least some of these were of rather infrequent 

40 
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occurrence, and a knowledge of them, therefore, not very 
important. It was concluded that an investigation should 
be made in the effort to secure a list of the 500 most common 
phrases in actual use. Inasmuch as this investigation was 
of the same nature as that of Ayres leading to his list of 
1,000 commonest words, it may be well to describe, very 
briefly, both investigations. 

During the years 1914 and 1915 the Division of Education 
of the Russell Sage Foundation conducted a study with 
the object of developing a scale for measuring the attain- 
ment of school children in spelling. For this purpose an 
effort was made to select the commonest words in the Eng- 
lish language. This was accomplished by combining the re- 
sults of four investigations, each of which aimed at identify- 
ing the commonest words. 

These four studies were : First, Rev. J. Knowles, London, 
England, 1904, "The London Point System of Reading for 
the Blind," including a tabulation of 100,000 words from 
the Bible and various authors; second, R. C. Eldridge, 
Niagara Falls, 1911, "Six Thousand G)mmon English 
Words," including a tabulation of 43,989 words; third, 
Russell Sage Foundation Monograph, 1913, "The Spelling 
Vocabularies of Personal and Business Letters, with a tabu- 
lation of 23,629 words; fourth. Cook and O'Shea, 1914, 
"The Child and His Spelling," including a tabulation of 
some 200,000 words. 

By combining these four studies, including a total of about 
368,000 words, written by more than 2,500 different persons, 
it was found possible to select a list of 1,000 words with 
the highest frequencies, which may therefore be regarded 
as the commonest words in the English language, so far as 
our information goes.* The thousand words constitute about 
92 per cent of ordinary composition. These words were 
arranged in the form of a scale and published in a mono- 
graph entitled, "Measurement of Ability in Spelling," which 



* More recently Thorndike's "Word-Book for Teachers" bat been publiihed, 
giTing the 10,000 most common words, and superseding all earlier studies. 
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has proved to be a very important contribution to the 
teaching of spelling. It is believed that die teaching of 
shorthand may be no less aided by the use of these same 
words in the form of a shorthand scale, especially since 
these words will constitute so large a part (92 per cent) of 
all that the stenographer will ever be called upon to write. 

An investigation, similar to those which were combined in 
the study just described, was made for the purpose of deriv- 
ing a list of the most common phrases in such literature as 
stenographers are accustomed to "take." The material used 
for diis purpose comprised the following books : the "Legend 
of Sleepy Hollow" and "Rip Van Winkle" from Irving's 
"Sketch Book;" "Gregg Speed Studies;" "Alice's Adven- 
tures in Wonderland," by Lewis Carroll ; "Graded Readings 
in Gregg Shorthand," by Alice M. Hunter; "The Art of 
Making a Speech;" "Gregg Shorthand Reader;" and two 
popular dictation books, containing modern business letters 
and literary matter, "Dictation Course in Business Litera- 
ture, Book I," Reigner, the H. M. Rowe Co., and Eldridge's 
"Shorthand Dictation Exercises," by the American Book 
Company. 

This body of material is estimated at approximately 
5(X),0CX) words. Much of the material may be had from 
the publishers of Gregg Shorthand in the form of expert 
notes. It was a simple matter to tabulate the phrases as 
used by the writers of these notes. The authority of the 
publisher's experts is back of the selection of the phrases. 
Otherwise there might be some difference of opinion as to 
what words should be "phrased." In the case of the material 
for which no shorthand notes are published, the plan was 
to have an expert teacher of shorthand underscore with a 
pencil the groups of words which should be phrased in 
writing. Clerical workers then went over these sheets and 
counted the phrases as underscored. 

6,418 different phrases were tabulated, with the number 
of appearances of each — ^a total of 41,421 phrases. Inci- 
dentally, the great importance of phrasing for success in 
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shorthand work may be seen from the fact that there occurs 
on the average one phrase to every ten or twelve words. 

It was then discovered that by selecting from the entire 
mass of material all phrases which had been found to occur 
fourteen or more times, a list of 500 phrases was secured, 
which may with some justification be regarded as the 500 
commonest phrases in the English language, or at least in 
those forms of literature included in the investigation. Ap- 
proximately three-fifths of this material consists of business 
letters. The remainder is of miscellaneous sorts, including 
literature, newspaper editorials, extracts from addresses, and 
so forth. 

It should be noted that in counting the frequencies of the 
phrases included in the 500, the frequencies of other less 
common phrases, of which certain of these form a part, 
were added. For example, the phrase, "and have" was cred- 
ited also for all occurrences of such phrases as, "and have 
the," "and have you," etc. This was done for the reason 
that it was felt that only by so doing would the several 
phrases be given the importance that they deserve. 

Those who are acquainted with shorthand will not need 
an explanation of the fact that many combinations of words 
are included in the list which are not phrases in the ordinary 
sense of the word "phrase" as used in grammar. For the 
purpose of this investigation any group of words written 
"joined," or together, is regarded as a phrase. 

The total of the frequencies of the 500 commonest phrases 
is 32,353, out of a total of 41,421 phrases tabulated, or 78 
per cent. This means that pupils who master the 500 phrases 
will be able to write not less than 78 per cent of all phrases 
they meet, as a result of this practice alone. The fifty com- 
monest phrases have a total frequency of 16,903, or about 
41 per cent of all the phrases tabulated. 

The 1,000 commonest words and 500 commonest phrases 
were arranged in ten Vocabulary Tests, (for which see ap- 
pendix) known as C-1, C-Z, ... C- 10, including 100 words 
and 50 phrases to each test. The words and phrases for the* 
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several tests were selected in a purely chance order, by 
taking for test C-1 every tenth word or phrase, for C-2 the 
words and phrases next following, and in like manner for 
the other eight tests. These tests simply give die words and 
phrases in columns, with spaces opposite for the student's 
outlines. On the first page of each test will be found all 
the directions required by the teacher. 

It is believed that the material included in diese ten tests 
will ultimately have great value as a body of drill material 
for the teacher's use. Inasmuch as these words make up 
approximately 92 per cent of ordinary composition, and the 
phrases 78 per cent of all phrases commonly met with, it 
will be found a very effective method of teaching, to drill 
this small body of material until thoroughly mastered by 
the pupil, so that it may be written rapidly and correctly. 
This will improve speed of writing, and will go a long way 
in securing legibility. 

In order to secure data for the calculation of the values or 
difficulties of the words and phrases, teachers of shorthand 
were invited to cooperate in the construction of the scale 
by using the tests with their classes and returning them for 
scoring and tabulation. 

In order that the tests might be scored in accordance with 
a uniform procedure, the scoring was not left to the teachers, 
but instead the teachers were requested to send in the tests 
themselves, after having scored them for their own purposes. 
The tests were given just before the close of school in June, 
1921. 2,818 tests were received, an average of 281.8 for 
each of the ten forms of the C tests. These were scored in 
accordance with the following directions : 

Standard Directions for Scoring the C Tests 

1. All words and phrases are to be scored strictly In accordance 
with the Gregg system, as per key.* 

2. Where the key gives two forms, either should be counted cor- 
rect. 

3. The dot for ''h" on words like "had" may or may not be used 
Count is correct with or without the dot. 



* The key was i>repared by a oammlttee of experts appointed by the 
Gregg publishers, and is regarded as authoritative. 
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4. Capital letters not indicated by „, counted wrong. 

5. Whenever the intention of the writer was correct, give full 
credit, even though the word is poorly written. This is not a test 
for quality of writing. 

6. If the word or i^rase is so poorly written that you cannot be 
sure the writer had the correct thing in mind, count it wrong. 

7. Pay no attention to other marks made by teachers. Only the 
marks made in our own scoring will be counted. Use a blue pencil. 

8. The first consonant should be reasonably near the line of writ- 
ing. One-sixteenth of an inch is reasonably near. If further from 
the line of writing, count it wrong. (This rule does not apply to 
such consonants as s, x, w, h, and sh.) 

In accordance with these standard directions, three dif- 
ferent clerical helpers shared in the work of scoring tests 
C-1, C-2, C-3, C-4 and C-5, while the remaining five forms 
were all scored by a single person. The median number 
of correct responses on the first five tests was 116.4, while 
on the last five it was 117.2. This indicates a variation of 
eight-tenths of a point in the scoring of the tests by different 
persons, showing that the scoring of vocabulary tests is 
more objective than might have been supposed. This argu- 
ment is based on the assumption that the ten forms of the 
C test are of equal difficulty. Inasmuch as each form repre- 
sents a purely random selection of 150 elements from a 
list of 1,500, the assumption seems a perfectly rational one. 

A study of the following table appears to the writer to 
justify these conclusions: 

1. That the ten forms of the C tests are approximately equal in 
difiiculty. 

2. That the work of different scorers is satisfactorily objective. 

3. That the ntmiber of cases is large enough to insure the relia- 
bility of the norms within three or five per cent. The extreme varia- 
tion between the medians is found between C-1 and C-4, 8.5 points, 
or 5.7 per cent of the total 150 points. 
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TABLE X 

Number of Cases and Median Scores on the C Tests 

(2818 Cases) 



No. of cases in different groups 
by jresrs 



Median scores for groups who 
had studied shorthand the time 
indicated, in years. 





1 


ly^ 


2 


1 All 1 


1 


IVi 


2 


All groups 


C- 1 


158 


162 


45 


365 


1072 


115.9 


115.5 


111.7 


C-2 


144 


103 


45 


292 


110.6 


122.3 


115. 


115J 


C- 3 


127 


85 


47 


259 


107.9 


121.5 


118 J 


115.1 


C-4 


115 


95 


44 


254 


115. 


123.9 


122.1 


1202 


C- 5 


138 


81 


54 


273 


114. 


125.3 


122.6 


119.5 


C-6 


114 


79 


62 


255 


113.7 


1212 


112.1 


115.7 


C- 7 


108 


91 


67 


266 


113.6 


124.5 


121.8 


120. 


C-8 


108 


93 


89 


290 


1112 


123.4 


119.4 


119. 


C- 9 


167 


79 


52 


298 


112.6 


122. 


117.5 


116. 


C-10 


133 


80 


53 


266 


112.4 


121.9 


114. 


115.4 


Avg. 


















1-5 


136 


105 


47 


288 


110.9 


122. 


118.7 


116.4 


Avg. 


















6-10 


126 


80 


65 


275 


112.7 


122.6 


117. 


1172 



The distribution of ability in knowledge of the system as 
measured by the C tests is indicated on the following graph. 



PTftantr 
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M Itf 



Ol M M* m 



n^.6. Distribution of 2818 Scores on i^xoMary Tksts. 



It will be noticed that there is a scattering .9 of one per cent 
of the 2,818 cases who make scores ranging from to 60 
per cent correct responses on the C tests. From 60 to 100 
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per cent or from 90 to 150 points the distribution shows 
a fairly close approximation to that of normal frequency. 

The most noticeable feature of the results found for the 
three groups who had had shorthand instruction one year, 
one and one-half years, and two years respectfully, is the 
fact that their medians show very slight differences. The 
improvement from the first year to the one and one-half 
year group is approximately 8 per cent, while from the one 
to the two year group it is only 4 per cent. The fact that 
the second year group seems to be slightly inferior to those 
who had a half year less instruction, is probably to be ex- 
plained as due to the selection of the schools tested. But 
taken with the other facts just noted, it does justify the 
conclusion that the second year of shorthand instruction 
makes very little improvement in the pupil's ability to use 
die system. 

These facts, together with the further fact that the distri- 
butions for the different groups are very similar, are shown 
by the following table of quartile points. The figures indi- 
cate percentages of correct responses. 

TABLE XI 

Quartile Points in Per Cent of Correct Responses for Groups 
Who Have Had Instruction the Number of 

Years Indicated 



1 I yr. 1% yxs. | a yrs. | AH 


01 67 

02 74 

03 81 


75 
81 
86 


71 
78 
84 


70 
78 
84 



The similarity of the three curves is shown in Figure 
7. The writer regards the above figures, together 
with the other facts that have been presented, as satisfac- 
torily justifying the procedure which was followed in pre- 
paring the scale for knowledge of the system. This pro- 
cedure we must now describe. 

After all the test sheets had been carefully scored in 
accordance with the standard procedure already described, 
the number of incorrect responses to each of the 1,500 words 
and phrases was counted, the percentage of incorrect re- 
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sponses to each word was calculated, and from this figure 
the percentage of correct responses to each word or phrase 
was derived. Each word and phrase was then placed in 
the column of die scale (for which see appendix) to which 
its record showed it to belong. This means, therefore, that 
words or phrases found in the column marked "84" for 
example, have been found to be of such difficulty that if a 
test be made up of these words and given to a class of pupils 
who have had from one to two years of instruction in short- 
hand, the class should make a median score of approximately 
84 per cent, if it is up to "standard." 

In arranging this scale the plan used by Ayres in con- 
structing his Spelling Scale has been adopted. For an ex- 
planation of the dieory underlying this type of scale the 
reader is referred to his monograph, "The Measurement of 
Ability in Spelling." The final paragraph of his discussion, 
however, applies with equal force to this scale, and is there- 
fore quoted with the change of just a few words. "In all 
such testing it must be remembered that the present scale 
. . . will become increasingly and rapidly less reliable for 
measuring purposes as the children become more accustomed 
to writing these particular words and phrases. In proportion 
as these lists are used for the purposes of classroom drill, 
the scale will become untrustworthy as a measuring instru- 
ment. Probably die scale will have served its greatest use- 
fulness in any locality when the school children have mastered 
these 1,0CX) words and 500 phrases so thoroughly that the 
scale has become quite useless as a measuring instrument." 
(Changes or additions are denoted by italics.) 

Inasmuch as the differences in ability between the three 
separate groups tested are so small as to be negligible, no 
differentiation is made on die scale between the norms for 
those who have had shorthand instruction one year, one and 
one-half years, or two years. The words were placed in 
their respective coltmms on the basis of their record in all 
three groups combined. For those who have had shorthand 
but one year the norms may be regarded as approximately 
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one-half step too high. For those who have had instruction 
one and one-half or two years, the norms are probably a 
half step too low. It would be statistically possible, of 
course, to work out this scale in such a way as to make the 
slight differentiations which the data seem to show. To do 
so, however, would be to set up a foolishly elaborate statis- 
tical procedure, based on a fundamental procedure in 
collecting data which was not of so extended or per- 
fect a nature as to justify the elaboration. It 
would, furthermore, be making distinctions of such un- 
important proportions that they would be invalidated or out- 
weighed by minor variations or errors in the procedure of 
giving and scoring tests. It is felt that such elaboration 
would lay one open to a very just charge of straining at a 
gnat and swallowing a camel, particularly in view of the 
fact that the average number of cases on which each word 
was scaled was only 282. 



VII. SUMMARY 

We have seen that the measurement of shorthand ability 
involves the measurement of reading ability, speed of writing, 
quality of writing, and knowledge of the system. Accord- 
ingly we have constructed tests and scales as follows : 

1. Test A-1, Reading Ability. 

2. Tests B-1 and B-2, Speed of Writing. 

3. A Measuring Scale for Gregg Shorthand Penmanship. 

4. A Scale for Measuring Knowledge of Gregg Shorthand. (The 
data for this scale were derived from the use of ten Vocabulary 
Tests, C-1 to C-10.) 

From the use of these tests and scales data have been 
collected which seem to justify the following suggestions 
as to the teaching of shorthand: 

1. The scores for reading ability are too low for efficiency in 
stenographic work. More practice needs to be given in reading 
shorthand. 

2. The second year group shows an improvement of only five per 
cent over the first year group in quality of shorthand penmanship. 
This condition calls for some remedy. 

3. The question of "artistr/' versus mere legibility in shorthand 
penmanship needs to be settled. After pupils have attained to a 
legible shorthand, there is little justification for spending time in 
the effort to get beauty. 

4. The one school whose results in shorthand penmanship were 
most outstanding, used the device of having students who had trouble 
in the formation of their outlines, trace them by using tracing paper, 
until they got the "swing of it." 

5. In Imowledge of the system the second year group does no 
better than the first. The explanation is probably to be found in 
the lack of a definite goal and in scattered and wasted practice. 

6. Emphasis should be placed upon drill or practice with a view 
to the mastery of the 1,000 commonest words and 500 commonest 
phrases. These make up 92 per cent of the words in English ccnn- 
position, and 78 per cent of the phrases. 

7. Many pupils fail to write words clearly, even though they have 
memorized the rules involved. Emphasis should be placed upon 
writing correctly, rather than upon the rules of the system. 

8. Tablets containing the 1,500 words and phrases appropriately 
arranged in drill sheets, would be an effective teaching device. 

9. The data derived f rcmi the nearly 3,000 vocabulary tests, nearly 
450,000 attempts to write words and phrases, show the degree of 
accuracy to be approximately 78 per cent. More intensive practice 
on a smaller number of the most common words and phrases would 
greatly improve this record. 
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Pupil's Score. 



A SERIES OF TESTS IN GREGG SHORTHAND 

Arranged by Elmer Hoke, A. M. 

Copfright. 1021. by the Gregg Publiehing ComiMuiy 



TEST A-1 Reading AhiUty 



Published by 

THE GREGG PUBLISHING COMPANY 
28S Fiflii ATsmiep New York City 



Nsme Age 

Yean lioothf 



Sex Grade. 



City State Date. 



Sdiool Teacher. 



Directions tot Giving Test 



1« Digtribnte pspen fgoe up on the desks. Adc pupils not to open pspen untfl the signsl is ffnai. 

t. Have pupils fill in Uanks on the cover page or as many of them as may be desired. 

8. Tlien ssy: "On the inside of this folder are two letters in shorthand. Bead these business 
leltfln^ and in eadi case where a choice of words is given, undermsore ihs correct word, so that the 
letter will make sense. Accuracy is as impwtant as speed. When I ssy, 'Beady, start,' open your 
paper and woik for three minutes* until I ssy, 'Stop.' 



*tt 



4. With watdi in hand carefuDy keep the time; allow exactly three minutes, when the signal. 
"Stop** ^lould be given and papers collected. 
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13 As 
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16 in 

17 to 

18 will 
Z9 easier 
ao holders 
ai ttieir 
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as and 

a6 and 
a7 you 
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30 of 

31 booklet 
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35 cash 

36 allowed 

37 year 
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41 if 
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43 you 

44 furnish 

45 you 

46 everything 
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48 give 
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Teacher's Key to Gregg Shorthand 

Test A-1 

Directioins tor Scoring 

In scoring these tests lay the k^ beside the paper an 
with a red pencil make a check mark on the margin of tli 
paper opposite each wrong choice if any. The word 
given in this key are the words which should be undei 
scored. If the other word is underscored, or if neithc 
or both are underscored, it is counted wrong. 

Find the number of the last choice made by referenc 
to the number opposite that word on this key. Vtot 
this number deduct twice the number of wrong choice 
made. Example: Suppose the last choice made i 
"work," No. 28. And suppose two wrong dioioes si 
made. Twice two, or four, subtracted from 2S, leave 
19, the net number of correct choices. 

Refer to the Class Record Sheet. Make a tally mail 
in the space after the number of net choices. Hie acoom 
panying score may then be placed on the piqnl's papa 
at the place indicated. Thenumberof taOy marks in eid 
space on the Class Record Sheet may then be counted am 
extended to the second space, showing the number 
pupils in each group. (Scores show the number of woid 
read correctly per minute.) 

Send one copy of the Class Record Sheet to the 

QRBGO PUBLISHINQ COMPANY 

285 Fifth Avenue 

New York City 

Copfrishi, 1021, by the Qnn Pobliahiiic 
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CLASS RECORD SHEET 



To be used with Series A Tests in Gregg Shorthand. 



Stete. 



Date. 



chool Teacher 



Grade. 



Net 
Numbeii 

of 
Cofrect 
Chokes 


Score 


Tallies 


No. 

of 

Pupils 


Net 
Number 

of 
Correct 
Choices 


Score 


TaOief 


No. 
of 

Pupils 


50 


167 






25 


83 






40 


163 






24 


80 






48 


160 






23 


77 






47 


157 






22 


73 






46 


153 






21 


70 






45 


150 






20 


67 






44 


147 






10 


63 






48 


143 






18 


60 






48 


140 






17 


57 






41 


187 






16 


53 






40 


183 






15 


50 






89 


180 






14 


47 






88 


187 






13 


43 






87 


123 






12 


40 






86 


120 






11 


37 






85 


117 






10 


33 






84 


113 






9 


30 






88 


110 






8 


27 






88 


107 






7 


23 






81 


103 






6 


20 






80 


100 






5 


17 






89 


97 






4 


13 






88 


93 






3 


10 






87 


90 






2 


7 






26 


87 






1 


3 







Send one copy of tfaia 8heet to the Oregg Publishing Company, New York City. 

Copyright! 1921, by tlie Gregg Publishing Company 
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A SERIES OF TESTS IN GREGG SHORTHAND 

Arranged by Elmer Hoke, A. M. 



TEST B-1 Speed o/ Writing 



Published by 

THE GREGG PUBUSHING COMPANY 
285 Fifth ATemiep New York City 



Name Age 

Tcan liontl 

Race Sex Grade 



City State Date. 



School Teacher 



Directions £3r Giving Test 

1. Distribute papers face up on the dedcs. Ask pupils not to open papers untfl the mgaaJ is gifei< 

2. Have pupils fill in blanks on the cover page, or as many of them as may be desired. 

S. Then say: "On the inside of this folder there is an article of 400 words. The artide is pnntec 
both in longhand and in shorthand. When I say, 'Start,' open your papers and copy the dMrthm 
as rapidly and as neatly as possible in the space left for that purpose. I will allow exactly tm 
minutes. No one will be able to finish. When I say, 'Stop,' raise your pencils or pens immediately.' 

4. With watch in hand carefully keep the time; allow exactly two minutes, when the signti 
Stop" should be given and the papers collected. 

Copyriffht, 1921. by the Qregg Publbhinc Company 
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Thinking I Can 



The twentieth centuty fonnulators of business ethics have builded squarel; 



apoQ the basis that respect for the good and true begins with the pronoun of th( 




first person. No man can really be true to himself who. has not an abiding fait 



in himself. Here lies the chief comer stone of scientific salesmanship. Th 
first important sellmg transaction with which one can be identified is a three 
cornered transaction. He is the salesman, purchaser, and the thing sold. Fo: 



^ 



no salesman — ^and that term includes every man or woman who earns a living b; 



S? = 



^ 



z 



/O. 



i^ 



■^ 



c 



hand or head-^can be a success in this life until he has succeeded in selling himse 



?■ 



to himself. When he has once made that confident analysb it should be easy for hii 



to api^ the same principles to other commodities which he may offer for sak 



64 



But there may always be this difference in offering one*s wares and imesc 



for sale: in the former case the price b r^gukted by the kw of sui^Iy and demand 




but in the ktter case the price is arbitrary. Indeed^I may be an autocrat an 

( ^^^ — o^ ^^ ^ cpp ^ <y ^ 



r ■ 



stamp whatever value I will upon myself. I may imprint my s»vices with th 




y^ 




C7 — O 



mental trade-mark of superiority and carefully store them away against the 



ja 



^ 



^? 



hour of made-to-measure customers, or I may throw myself upon the bargaii 



<^ 75 ^ 




counter to be fingered over by the basement crowd. Every man b first greai 
or small according to his own calcuktion. Spiritual bankrupt<^ is alwayi 
several days ahead of the sheriff. Our mental coUapse is the result of a 




i^ 




C/ 



poor system of bookkeeping. We strike off our trial balance, having 



underscored self-liquidating liabilities, and overlooked important assets. 



t 
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Baople an iviOuig to bdieve a fldf-helpiDg man a going concern until lu 



C • ^ 



stops disoounting his bills and begins to walk stoop-shouldered, Emerson saic 



r 



f 



(hat the best ligHfaiing rod for self-protection is one's spine. Indeed one's 



/" 



^ 



^~ 



earriage is more than an incident in his credit. Men have telltale gaits like 



y ' 




thofouglibredB and truck horses. A careful banker would sooner look intc 



f 



■ -^ 




joat face than into your strong box, for if you have been serving the god 
of doubt, of personal distrust, these things are pictured in your countenanoei 

Cf d^ >^ /^ ^ % 




sad axe more eloquent to the man who lends than coupon papers. 

A man may lack the confidence of every banker in his community and 



yet be stroni^y underwritten if he has the security of his own souL ^ 



N«w S 
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Teacher's Key to Gregg Shorthand Test B-1 

In flooring Test B-1 find the last word written by the pupil, and refer to the foUowing key to find 
number of that word. Divide by two to find the score in words per minute; mark this soore on i 
pupil's paper, and tally the same on the Class Record Sheet. 

Thinking I Can 

1 2^ 8 4 6 6 789 10 

The twentieth century formulators of business ethics have builded aquar 

11 12 13^ 14 15 16 17 18 10 20 21 22 23 24 25 

upon the basis that respect for the good and true begins with the pronoun of 1 

27 28 2030 3132 33343536 37383040 41 \ 

first person. No man can really be true to himself who has not an abiding fa 

43 44 45 46 47 48 40 50 51 52 58 

in himself. Here lies the chief comer stone of scientific salesmanship. 1 

55 56 57 ^ . ? 60 61 62 63 64 65 66 « 

first important selling transaction with which one can be identified is a thr 

68 60 70 71 72 73 74 71 76 77 78 

cornered transaction. He is the salesman, purchaser, and the thing sold. 1 

80 81 82838485 86 87 8880 00 010208 

no salesman — and that term includes every man or woman who earns a living 

05 06 07 08 00100 101 102 103 104 105 106 107 108 100 110 111 

hand or head — can be a success in this life until he has succeeded in selling hinu 

112 113 114 115 116 117 118 110 120 121 122 123 134 125 

to himself. When he has once made that confident analysis it should be ea^ ; 

127 128 120 130 131 ^ 132 133 134 ^^ . . ^^ ^^ ^^ ^^ IM ^' 

him to apply the same principles to other commodities which he may offer for 8« 

142 143 144 145 146 147 148 140 150 151 152 158 IM 

But there may always be this difference in offering one's wares and ones 

155 156 157 158 150 160 161 162 163 164 165 166 167 168 160 170 IH 

for sale: in the former case the price is regulated by the law of supply and demai 

172 173 174 175 176 177 178 170 180 181 182 183 184 185 186 ] 

but in the latter case the price is arbitrary. Indeed I may be an autocrat a 

188 180 100 101 102 103 104 105 106 ^ 107 108 100 200 I 

stamp whatever value I will upon myself. I may imprint my services with t 

202 203 204 205 206 207 208 200 210 211 212 J 

mental trade-mark of superiority and carefully store them away against t 

214 215 216 217 218 210 220 221 222 223 224 225 226 227 

hour of made-to-measure customers, or I may throw myself upon the bargi 

228220 230 231 232 233234 235 236 237 2382803402 

counter to be fingered over by the basement crowd. Every man is first gn 

242 243 244 245 246 247 248 ^ 240 250 251 252 & 

or small according to his own calculation. Spiritual bankruptcy is always seve 

254 255 256 257 258 250 260 261 262 263 264 265 266 SNT 2BI 

days ahead of the sheriff. Our mental collapse is the result of a poor systi 

260 270 ^ 271 272 273 274 275 276 277 m I 

of bookkeepuig. We strike off our trial balance, having underscored ai 

280^ ^ 281 282 283 . ^^ 285 286 287 288 

liquidating liabilities, and overlooked important assets. People are willing 

200 201 202 203^ 204 205 206 207 208 200 300 801 802 8 

believe a self-helpuig man a going concern until he stops discounting his b 

304 305 306 307 308 300 310 311 312 313 314 81ft 

and begins to walk stoop-shouldered. Emerson said that the best Uditni 

316 317 318 310 ^ 320 321 322 323 324 325 326 827 » 

?od for self-protection is one's spine. Indeed one's carriage is more than 

330 331 332 333^ 334 335 336337338 330 84084 

incident in his credit. Men have telltale gaits like thoroughbreds and in 

342 343 344 345 346 347 348 340 350 351 852 858 854 85 

horses. A careful banker would sooner look into your face than into your strc 

356 357 358 350 360 361 362 363 364 365 366 367 368 860 8] 

box, for if you have been serving the god of doubt, of personal distrust, tb 

371 372 ^ 373 374 375 376 377 378 370 380 881 882 888 ] 

things are pictured in your countenance, and are more eloquent to the man n 

385 386 387 388 

lends than coupon papers. 

380 300 301 302 303 304 305 306 307 808 800 400 .^ 401 408 

A man may lack the confidence of every banker in his community and yet 

404 405 ^ 406 407 408 400 410 411 412 413 414 

stron^^ly underwritten if he has the security of his own soul. 

Copyricht, 1021, by the Gregg Publishing Compaoy 
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TEST B-2 



Eyes That See 



/<? —m ( J ^ 



On board the vessel that night I met the most wonderful man of all my 
Aoquaintances. I cannot tell you his name for, indeed, I never knew him, and 




f«t I call him the most interesting man I have ever met. He was a steerage 

. — ^ — c 7 ^ ^ — ^^ ^ • >y 

and had come up from the bowels of the ship after midnight to get 



/ 




• few breaths of fresh air. I found that he was a billposter for one of our great 
.American circuses. He was not an educated man from the viewpoint of books, 
-tat he was a post graduate in the university of observation. He told me all 
/dxmt the wonderful institution — the circus. I thought I knew all about the 
circus. Years ago I used to get up at four o'clock in the morning and watch the 




68 



areas until it left the next monuDg at four. I thoudit I knew tXL about i 



9 



1^^ 



I knew aU the animals by thdr fint names, and was on intimate ienns wil 



the gentleman who issued the complimentaiy tickets for services rendecei 



But I found out on this night that I really knew nothing about the circa 



YHieii this billpostel* told me the clock-like precision with which this grea 



<r 



institution moved from one city to another; when he told me how many beevc 



and potatoes were required to feed all the people; the difference in pay betwea 



<^ 




/^ 



^ 



Z 



^ 



the men who drove the tent stakes and those who did the acting, how I wisfaa 



^•— ^? 




that every boy and girl in this country might learn what I learned about a drctt 



that niglit from this steerage passenger. He had been all over Europe putting op 



r 



/ 
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his circus bills, and everywhere he had been he had appropriated tlie treasures ol 

^ "^ "^ €> - -y' *- 



^ i^ 




the old world. At two o'clock that morning, when I allowed this billposter to g( 



^ 



back to the steerage, I declared that that night had been far more entertaininj 



7 



and i»ofitable to me than any I had spent at Harvard University. 

In bold contrast I recall the experience of a man who recently came int< 




c/ • 



my office in New York. He was applying for a stenographic position 



In reply to my query as to hb education and experience he said that he ha 

9^ ^^ -^ / ^ 




graduated from one of our largest western universities, was a stenographer c 



r 



2 



three years* experience, was thirty years of age, and desired fifteen dollars a week 
^ ^^ C ^ JO ^ 



/^ 
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Teacher's Key to Gregg Shorthand Test B-2 

In scoring Test B-2 find the last word written by the pupil and refer to the foDowuig k^ to fin 
the number of that word. Divide by two to find the score in words per minute; mark this score o 
the pupil's paper and tally the same on the Class Record Sheet. 

Eyes That See 

12 3 4 6 6 7 8 10 11 IS IS 14 IJ 

On board the vessel that night I met the most wonderful man of all o^ 

16 17 18 10 20 21 22 23 24 25 26 87 S8 21 

acquaintances. I cannot tell you his name for, indeed, I never knew him» an 

30 31323334 35 36^ 373839 40 41 424844 45 

yet I call him the most interesting man I have ever met. He was a steera( 

46 47 48 49 50 5152 5354555657 58 506 

passenger and had come up from the bowels of the ship after midnight to gi 

61 62 63 646566 67 68 6970 71 72 73 74 75 767778 

a few breaths of fresh air. I found that he was a billposter for one dt our gro 

79 80 81828384 85 868788 80 00 01 

American circuses. He was not an educated man from the viewpoint of book 

02 03 94 95 96 97 98 99 100 101 102 103 104 106 1 

but he was a post graduate in the university of observation. He told me a 

107 108 109 110 ^ 111 112 113 114 115 116 117 118 11 

about the wonderful institution — the circus. I thought I knew all about tl 

120 121 122 123 124 125 126 127 128 129 130 131 132 133^ 134 135 U 

circus. Years ago I used to get up at four o'clock in the morning and watch it 

^ 137 138 139 140 141 142 143 144 145 146 147 148 140 150 151 153 U 

circus until it left the next morning at four. I thought I knew all about it. 

154 155 156 157 158 150 160 161 162 163 164 165 166 167 16 

knew all the animals by their first names, and was on intimate tenns with tli 

160 170 ^ 171 172 173 ^ 174 175 176 177 178 1! 

gentleman who issued the complimentary tickets for services rendered. But 

180 181 182 183 184 185 186 187 188 180^ 100 101 102 181 

found out on this night that I really knew nothing about t^e circus. Wbe 

104 ^ 105 106 107 198 100 200 201 202 203 204 205 206 ^ 

this billposter told me the clock-like precision with which this great institutia 

207 208 209 210 211 212 213 214 215 216 217 218 210 220 221 

moved from one city to another; when he told me how many beeves and potatoc 

222 223 224 225 226 227 228 220 230 231 232 233 284 835 2M 

were required to feed all the people; the difference in pay between the men wb 

237 238 230 240 241 242 243 244 245 246 247 248 240 250 251 2B 

drove the tent stakes and those who did the acting, how I wished that every bq 

253 254 255 256 257 258 250 260 261 262 263 264 265 266 S67 90 

and girl in this country might learn what I learned about a circus that ni^^t froi 

260 270 271 272 273 274 275 276 277 278 270 280 281 SB 

this steerage passenger. He had been all over Europe putting up his circus biBi 

283 284 285286287288280 200^ 201 202 203204 295 996 

and everywhere he had been he had appropriated the treasures of the old worU 

207 298 209 300 301 302303304 305306 807808809 810 S 

At two o'clock that morning, when I allowed this billposter to go back to to 

312 313 314 315 316 317 318 319 320 321 822 823 ^^ . . 

steerage, I declared that that night had been far more entertaining and profitabl 

325 326 327 328 329 330 331 332 333 . ^^ . 

to me than any I had spent at Harvard University. 

335 336 337 338 339 340 341 342 343 344 845 846 ' 847 ,9« 

In bold contrast I recall the experience of a man who recently came mt 

349 360 351 362 353 354 355 366 357 358 359 ^ 360^ 861 Stt 

my office in New York. He was applying for a stenographic position. In rq^ 

863 364 365 366 367 368 369 370 371 372 373 374 375 876 377 

to my query as to his education and experience he said that he had graduate 

378 379 380 381 882 383 . 384 ^ ^ 385 386 887 8M 880 990 

from one of our largest western universities, was a stenographer of three yetn 

391 392 393 394 395 396 397 398 399 400 401 408 

experience, was thirty years of age, and desired fifteen dollars a week. 

Cop3rright. 1921. by the Gregg Publiahiog Compftny 



71 



CLASS RECORD SHEET 

Copyrichi, 1921, by the Gregg Publiihing ComiMoy 

ro be used with Series B Tests in Gregg Shorthand. 
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Date. 



Teacher Grade. 
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Gfeneral Directions 

Tests of the Series B-1, B-2, are 
designed to measure not the quality 
of shorthand notes (for which a scale 
is being prepared), but the speed of 
writing shorthand when the correct 
outlines are given. These tests will 
not measure the pupil's knowledge 
of the system. Other tests will be 
prepared for that purpose. 

Directions for scoring are given 
with the Teacher's Key. Find the 
last word written by the pupil. Get 
the number of this word from the 
key. Divide by two to get the score 
in words per minute. Place this score 
on pupil's paper and a tally mark 
opposite the group within which the 
score falls. ^Vhen all papers have 
been scored, these tallies should be 
counted and tne total extended to 
the last column, under No. of Pupils, 



JDC copy of this sheet to the Gregg Publishing Company, New York City. 



xV 



\ 



72 



KEY TO THE TEXT OF THE 40 SPECIMENS 

OF SHORTHAND 
1. 

Bait Van Tassel was an easy, indulgent soul. He loved his datagh- 
ter better even than his pipe, and, like a reasonable man and an ex- 
cellent father, let her have her way in everything. His notable little 
wife, too, had enough to do to attend to her housdceeping and manage 
the 







^/ 



r. J 






y 



-A^ 




V 



But it is meet I should, in the true spirit of romantic story, give 
soqie accotmt of the looks and equipments of my hero and his steed 
The animal he bestrode was a broken-down plpw-horse, that had 
outlived almost everything but his viciousuess. He was gaunt and 
shagged, with ^ 



{ 



/< 



9^^ 




; 
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y^*^ r . <^*-»^ 
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3. 

Oh, she too had died but a short time since. She broke a blood- 
vessel in a fit of passion at a New England peddler. There was a 
drop of comfort, at least, in this intelligence. The honest man could 
contain himself no longer. He caught his daughter and her 



J ^ 



/ ^ . C^ 2^ - . > - / 
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4. 

In the fullness of their revelry, they fluttered, chirping and frolick- 
ing, from bush to bush, and tree to tree, capricious from the very 
profusion and variety around them. There was the honest cock- 
robin, the favorite game of stripling sportsmen, with its loud, queru- 
lous note; and the twittering blackbirds flying 




^ 
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5. 



A sloop was loitering in the distance, dropping slowly down with 
the tide, her sail hanging uselessly against the mast; and, as the 
reflection of the sky gleamed along the still water, it seemed as if the 
Tcssel was suspended in the air. It was toward evening that Ichabod 
arrived 






^lU 




^ 
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6. 



How solemnly they would listen to the contents, as drawled out by 
Derrick Van Bummel, the schoolmaster, — a dapper, learned little man, 
who was not to be daunted by the most gigantic word in the diction- 
ary; and how sagely they would deliberate upon public events some 
months after they had 

(For this specimen see quality 30 on the scale.) 



7. 



In the fullness of their revelry, they fluttered, chirping and frolick- 
ing, from bush to bush, and tree to tree, capricious from the very 
profusion and variety around them. There was the honest cock- 
robin, the favorite game of stripling sportsmen, with its loud, queru- 
lous note; and the twittering blackbirds flying 
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8. 

Just sufficient time had elapsed to enable each story-teller to dres3 
up his tale with a little becoming fiction, and, in the indistinctness of 
his recollection, to make himself the hero of every exploit There 
was the story of Doffue Martling, a large, blue-bearded Dutchman, 
who had nearly taken 

(For this specimen see quality 35 on tlie scale.) 

9. 

Your mere puny stripling, that winced at the least flourish of the 
rod, was passed by with indulgence; but the claims of justice were 
satisfied by inflicting a double portion on some little, tough, wrong- 
headed, broad-skirted Dutch urchin, who sulked and swelled and 
grew dogged and sullen beneath 

(For this specimen see quality 45 on the scale.) 

10. 

Bait Van Tassel was an easy, indulgent soul. He loved his daugh- 
ter better ^ven than his pipe, and, like a reasonable man and an ex- 
cellent father, let her have her way in everything. His notable little 
wife, too, had enough to do to attend to her housekeeping and manage 
the 




11. 

But the thought and feeling embodied in the words of great writers 
during the so-called classic days of Greece and Rome are truly and 
splendidly alive today for the simple reason that they were alive then ; 
sind are so true to the universal experience of mankind and so beau- 
tiful in (50) their expression that Time cannot touch them nor age 
wither their "infinite variety," 

(For this specimen see quality 95 on the scale.) 
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Then, as he wended his way, by swamp and stream and awful 
woodland, to the farmhouse where he happened to be quartered, 
every sound of nature, at that witching hour, fluttered his excited 
imagination, the moan of the whip-poor-will from the hillside; the 
boding cry of the tree-toad, that harbinger 




^ 




13. 

Brom Bones, however, was the hero of the scene, having come to 
the gathering on his favorite steed Daredevil, a creature, like him- 
self, full of mettle and mischief, and which no one but himself could 
manage. He was, in fact, noted for preferring vicious animals, given 
to all kinds of 

(For this tpecitnicn lee quality 60 on the scale.) 

14. 

Times grew worse and worse with Rip Van Winkle as years of 
matrimony rolled on. A tart temper never mellows with age, and a 
sharp tongue is the only edged tool that grows keener with constant 
use. For a long while he used to console himself, when driven from 
home 




^\ 



). 
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15. 

As he was a bachelor, and in nobody's debt, nobody troubled his 
head any more about him. The school was removed to a different 
quarter of the hollow, and another pedagogue reigned in his stead. It 
is true, an old farmer, who had been down to New York on a 




16. 

Something, however, I fear me, must have gone wrong; for he 
certainly sallied forth, after no very great interval, with an air quite 
desolate and chopf alien. Oh these women, these women I Could that 
girl have been playing off any of her coquettish tricks? Was her 
encouragement of the poor pedagogue 



o ^ 




/o 



17. 

Streaming files of wild ducks began to make their appearance high 
in the air. The bark of the squirrel might be heard from the groves 
of beech and hickory nuts, and the pensive whistle of the quail at in- 
tervals from the neighboring stubble-field. The small birds were 
taking their 
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18. 

Then, as he wended his way, by swamp and stream and awful 
woodland, to the farmhouse where he happened to be quartered, 
every sound of nature, at that witching hour, fluttered his exdfed 
imagination, — the moan of the whip-poor-will from the hillside; the 
boding cry of the tree-toad, that harbinger 



^,y<jak. 





79 



19. 

His rusty mane and tail were tangled and knotted with burrs. One 
eye had lost its pupil, and was glaring and spectral, but the other 
had the gleam of a genuine devil in it. Still he must have had fire 
and mettle in his day, if we may judge from 





: ^^ix-^ X 



An opening in the trees now cheered him with the hopes that the 
church bridge was at hand. The wavering reflection of a silver star 
in the bosom of the brook told him that he was not mistaken. He 
saw the waJls of the church dimly glaring under the trees 



9 
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21. 



This story was immediately matched by a thrice marvelous adven- 
ture of Brom Bones, who made light of the Galloping Hessian as 
an arrant jockey. He affirmed that, on returning one night from the 
neighboring village of Sing Sing, he had been overtaken by this mid- 
m'ght trooper ; that he had offered 

(For this specimen see quality O on the scale.) 



22. 

The schoolhouse, being deserted, soon fell to decay, and was re- 
ported to be haunted by the ghost of the unfortunate pedagogue; and 
the plow-boy, loitering homeward of a still summer evening, has often 
fancied his voice at a distance, chanting a melancholy psalm tune 
among the tranquil solitudes of 




2 
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23. 

There are three sorts of actions: those that are good, those that 
are bad, and those that are doubtful, and we ought to be cautious of 
those that are doubtful ; for we are in most danger of these doubtful 
actions, because they do not alarm us, and yet they insensibly (50) 
lead to greater transgressions, just as the shades of twilight gradu- 
ally reconcile us to darkness. 

(For tlm specimen see quality 85 on the toale.) 



24. 

The opinions of this junto were completely controlled by Nicholas 
Vedder, a patriarch of the village, and landlord of the inn, at the 
door of which he took his seat from morning till night, just moving 
sufficiently to avoid the sun, and keep in the shade of a large tree 

(For this specimen see quality 80 on the scale.) 



81 



25. 

He had overheard the boast of Bones, that he would "double the 
schoolmaster up and put him on a shelf;" and he was too wary 
to give him an opportunity. There was something extremely pro- 
vddng in this obstinately pacific system; it left Brom no alternative 
but to draw upon the 




i ^ ^ ^ ^^ 
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2S, 
His schoolhouse was a low building of one large room, rudely 
constructed of logs; the windows partly glazed, and partly patched 
with leaves of old copy-books. It was most ingeniously secured at 
vacant hours by a withe twisted in the handle of the door, and stakes 
set against the window-shutters; 



O 9 
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27. 



As to Rip's son and heir, who was the ditto of himself, seen 
leaning against the tree, he was employed to work on the farm, 
but evinced an hereditary disposition to attend to anything else but 
his business. Rip now restmied his old walks and habits. He soon 
found many 

(For this specimen see quality 75 on the scale.) 



No. V 



t^z 



2S. 

The poor fellow was now completely confounded. He doubted hi^ 
own identity, and whether he was himself or another man. In the 
midst of his bewilderment, the man m the cocked hat demanded who 
he was, and what was his name. "God knows !'' exclaimed he, at his 
wits' end. "I'm 

(For this specimen see quaUty 70 on the scale.) 

29. 

Such heaped-up platters of cakes of various and almost indescrib- 
able kinds, known only to experienced Dutch housewives! There 
was the doughty doughnut, the tender oly-koek, and the crisp and 
crumbling cruller; sweet cakes and short cakes, ginger cakes and 
honey cakes, and the whole family of cakes ; and then there 




30. 

There was a whisper, also, about securing the gun, and keeping 
the old fellow from doing mischief, at the very suggesticm of which 
the self-important man in the cocked hat retired with some precipita- 
tion. At this critical moment a fresh, comely woman pressed thro^;fa 
the throng to get a 
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31. 

Dame Van Winkle regarded them as companions in idleness, and 
even looked upon Wolf with an evil eye, as the cause of his mas- 
ter's going so often astray. True it is, in all points of spirit be- 
fitting an honorable dog, he was as courageous an animal as ever 
scoured the 



^^- 




Certain it is, the place still continues under the sway of some 
witching power, that holds a spell over the minds of the good people, 
causing them to walk in a continual revere. Ihey are given to all 
kinds of marvelous beliefs; are subject to trances and visions; and 
frequently 

CPor this specimen see qusAity 90 on die scale.) 

33. 

They are like those little nooks of still water which border a rapid 
stream, where we may see the straw and bubble riding quietly at 
anchor, or slowly revolving in their mimic harbor, undisturbed by 
the rush of the passing current. Though many years have elapsed 
since I trod the 

(For this specimen see quality 50 on the scale.) 

34. 

Fain would I pause to dwell upon the world of charms that burst 
upon the enraptured gaze of my hero, as he entered the state parlor 
of Van Tassel's mansion; not those of the bevy of buxom lasses, 
with their luxurious display of red and white, but the ample charms 

(For this q>ecimen see quality 55 on the scale.) 

35. 

He assisted the farmers occasionally in the lighter labors of their 
farms, helped to make hay, mended the fences, took the horses to 
water, drove the cows from pasture, and cut wood for the winter 
fire. He laid aside, too, all the dominant dignity and absolute sway 
with which he 

(For this specimen see quality 2$ on the scale.) 
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36. 

The gallant Ichabod now spent at least an extra half hour at his 
toilet, brushing and furbishing up his best and indeed only suit of 
rusty black, and arranging his looks by a bit of broken looking-glass 
that hung up in the schoolhouse. That he might make his appear- 
ance 

(For this q>ecimen see qtiolity 40 on the scale.) 

37. 

His rusty mane and tail were tangled and knotted with burrs. One 
eye had lost its pupil, and was glaring and spectral, but the other 
had the gleam of a genuine devil in it. Still he must have had fire 
and mettle in his day, if we may judge from 





^oL^ 



38. 

"I am your father I" cried he, — ^**young Rip Van Winkle once, old 
Rip Van Winkle now I Does anybody know poor Rip Van Wiirfcle ?" 
All stood amazed, until an old woman, tottering out from among the 
crowd, put her hand to her brow, and, peering under it in his face 
for a 

(For this specimen see quality 65 on the scale.) 

39. 

These magic book9 and the poetic scrawl were forthwith con- 
signed to the flames by Hans Van Ripper, who from that time for 
ward determined to send his children no more to school, (^serving 
that he never knew any good come of this same reading and writing. 
Whatever money the schoolmaster possessed 
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40. 

He was always ready for either a fight or a frolic; had more mis- 
chief than ill will in his composition; and, with all his overbearing 
roughness, there was a strong dash of waggish good-humor at bot- 
tom. He had three or four boon companions of his own stamp, who 
regarded 
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DIRECTIONS 

Write the following sentence on the blackboard in 
shorthand: 

1 28 4667 8 

'Tourscore and seven years ago our fathers brought 

9 10 11^ 12 18 14 16 16 ^ 17 ^ 18 

forth upon this continent a new nation, conceived in liberty, 

19 20 21 22 2'. . 2^ ^ 2^ 2*^ 2^ 

and dedicated to the proposition that all men are created 

29 

equal." 

Have the pupils write this three times for practice, to 
familiarize them with the text and the shorthand. Collect 
these papers. 

See to it that all have paper and two pencils (or foun- 
tain pen). Then say: "DO NOT WRITE ANYTHING 
UNTIL I GIVE YOU THE SIGNAL TO START. 
YOU WILL HAVE THREE MINUTES IN WHICH 
TO WRITE THE SENTENCE AS OFTEN AS YOU 
CAN. BE CAREFUL TO WRITE AS WELL AS 
YOU CAN. YOU WILL BE RATED BOTH FOR 
SPEED AND FOR QUALITY. START AND STOP 
PROMPTLY WHEN THE SIGNALS ARE GIVEN. 
ALL READY. START!" Keep the time very carefully, 
using a watch with a second-hand, allowing exactly three 
minutes. "STOPl" Collect the papers. 

The score for speed is ascertained by multiplying 29 
by the number of times the sentence has been completely 
written, adding the number of the last word written. This 
is the total number of words written and should be divided 
by three to get the score for speed in words per minute. 
Write this score in the upper right-hand corner of the paper. 

When all have been scored in this way, score the papers 
for quality by the use of the scale, writing this score under 
the score for speed. 

Enter the scores on the class record sheet by making a 
tally-mark in the square under the proper score for speed 
and opposite the score for quality. Total these scores both 
ways. 
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A SERIES OF TESTS IN GREGG SHORTHAND 

Arranged By Elmer HokOf A* M* 



TEST C-1 Vocabakay 



Published by 

THE GREGG PUBLISHING COMPANY 
New York Chicago Boston San Francisco London 



Name Age 



Race Sei Grade 



City State Date. 



School Teacher, 



How long have you studied Gregg Shorthand? Montb 



Directions for Giving Test 

1. Distribute papers face up on the desks. Ask pupils not to open papers until the signal is gifei< 

2. Have pupils fill in blanks on the corer page. 

8. Then say: "On the inside of this folder are 100 common words and 50 common phrases, wid 
a space opposite each. You are to write in these spaces the shorthand outlines for the accompsif 
ing words and phrases. Accuracy is as important as speed. Work as fast as you can do it coiiectff< 
When I say, 'Ready, Start,' you may begin work. You will be given enough time to finish the ii«ik» 

4. Give the rignal to begin work and collect the papers as they are finished. 

Copyrii^t, 1911, by the Qregg Publiahing Company 

Note. — ^The first pages of the other nine tests of the C series are identical with this, and ^ 
therefore not be given. Tests C-2 to C-10 follow immediately after this test. C-1. 
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lat 
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taa 




3ve 




ome 




or 




tde 




pring 




ice 




oon 




ake 




ear 




even 




laide 




oat 




old 




ay 





26. place 




27. every 




28. wind 




29. glad 




30. glass 




31. only 




32. Friday 




33. reach 




34. try 




35. dean 




36. these 




37. cent 




38. began 




39. stop 




40. turn 




41. date 




42. world 




43. once 




44. nothing 




45. order 




46. beside 




47. bom 




48. enter 




49. speak 




SO. off 





90 



51. understand 




52. office 




53. money 




54. offer 




55. wonder 




56. write 




57. broke 




58. April 




59. January 




60. doctor 




61. fifth 




62. retire 




63. proper 




64. personal 




65. company 




66. board 




67. until 




68. getting 




69. beautiful 




70. fortune 




71. department 




72. clerk 




73. destroy 




74. desire 




75. employ 


1 



76. crowd \ 


77. measure 




78. running 




79. information 




80. enclose 




81. statement 




82. neighbor 




83. drown 




84. illustrate 




85. conunon 




86. effect 




87. Christmas 




88. amve 




89. marriage 




90. piece 




91. voliune 




92. concern 




93. refer 




94. earliest 




95. expense 




96. material 




97. citizen 




98. session 




99. extreme 




100. preliminary 





101. of the 




102. younverytiuly 




103. I have 




104. there U 




105. of our 




106. there are 




107. and company 




108. to give 




109. five thousand 




110. to get 




111. at least 




112. we shaQ be 




113. of them 




114. they were 




lis. we wouM 




116. I think 




117. I know 




118. to send 




119. under the 




120. some of the 




121. that are 




122. to meet 




123. that you 




124. to place 




125. of that 





126. to find 




127. to my 




128. we had 




129. to his 




130, have you 




131. we have not 




132. no doubt 




133. have the 




134. which was 




135. he does 




136. with regard to 




137. on it 




138. of this kind 




139. in making 




140. along the 




141. two or three 




142. in which the 




143. you do not 




144. my dear sir 




145. we are net 




146. give us 




147. we shall take 
pleasure 




148. dear doctor 




149. might be 




150. to put 
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TESTC-2 



1. do 




2. see 




3. top 




4. us 




5. but 




6. look 




7. over 




8. km 




9. child 




10. door 




11. law 




12. then 




13. if 




14. ran 




15. tree 




16. river 




17. end 




18. came 


• 


19. Mr. 




20. west 




21. forget 




22. blue 


• 


23. rest 


24. read 




25. large 



26. report 




27. under 




28. print 




29. with 




30. party 




31. where 




32. hour 




33. better 




34. move 




35. spell 




36. club 




37. night 




38. able 




39. walk 




40. lesson 




41. road 




42. country 




43. own 




44. ground 




45. third 




46. teach 




47. goes 




48. railroad 




49. past 




SO. true 
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follow 




great 




ready 




suffer 




dre 




expect 




feel 




bistory 




mean 




bear 




eight 




refuse 




judge 




everything 




q[uite 




September 




mflHfltn 




ion't 




Bight 




empire 




obtain 




though 




newspaper 




nearly 


f 


property 





76. factory 




77. famous 




78. allow 




79. whom 




80. await 




81. perhaps 




82. weigh 




83. adopt 




84. different 




85. diamond 




86. distribute 




87. mterest 




88. supply 




89. further 




90. certain 




91. organize 




92. associate 




93. minute 




94. whether 




95. responsible 




96. suggest 




97. necessary 




98. secretary 




99. practical 




100. disappoint 





101. in the 




102. that the 




103. from the 




104. of his 




105. have been 




106. you are 




107. in which 




108. one of the 




109. you know 




110. to me 




111. you would 




112. if you are 




113. very much 




114. to go 




115. through the 




116. we encOose 




117. in order 




118. and in 




119. we do not 




120. that will 




121. who are 




122. you wiU be 




123. to him 




124. to receive 




125. thank you for 





126. to have you 




127. to them 




128. we should like 




129. to serve 




130. he could 




131. who had 




132. on account of 




133. he did 




134. why not 




135. he should 




136. would not 




137. should have 




138. sometime ago 




139. it would be 




140. as it is 




141. when they 




142. they wiU 




143. your account 




144. please let 




145. we beg 




146. in this country 




147. we should be glad 




148. every day 




149. more or less 




150. up the 





TEST C-3 
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ck 




lant 




01 




unday 
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Ftcr 




>ld 




appy 




08t 




18t 




Qe 




ear 





26. never 




27. most 




28. air 




29. mine 




30. upon 




31. week 




32. wife 




33. water 




34. delay 




35. poor 




36. seen 




37. pass 




38. gone 




39. grant 




40. half 




41. March 




42. meet 




43. before 




44. lead 




45. push 




46. happen 




47. hold 




48. imable 




49. might 




50. took 


I 
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51. charge 




52. Miss 




53. omit 




54. built 




55. pair 




56. need 




57. sure 




58. cause 




59. vote 




60. size 




61. afraid 




62. district 




63. weather 




64. rate 




65. none 




66. station 




67. truly 




68. Thursday 




69. travel 




70. mayor 




71. family 




72. o'clock 




73. daughter 




74. sometimes 




75. select 





76. publish 



77. serve 



78. position 



79. arrest 



80. suppose 



81. their 



82. wear 



83. secure 



84. object 



85. together 



86. general 



87. often 



88. assist 



89. serious 



90. witness 



91. summon 



92. automobile 



93. ought 



94. distinguish 



95. beginning 



96. mere 



97. divide 



• . • 



98. association 



99. proceed 



100. especially 



to the 




to you 




of this 




if you 




in this 




must be 




with your 




wewiU 




to see 




to say 




to this 




to know 




when the 




did not 




dear madam 




and have 




Ishould 




as to the 




we must 




we renuun 




will not 




and is 




to that 




we have been 




would have 





126. was the 




127. we could 




128. are you 




129. to work 




130. I don't 




131. by you 




132. so much 




133. I believe 




134. with our 




135. in connection with 




136. any one 




137. to learn 




138. this morning 




139. let me 




140. by which 




141. yea sir 




142. to speak 




143. will have 








145. we have the 




146. is in 




147. we thmk 




148. for him 




149. my dear Mr. 




150. upon his 
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TEST C-4 



1. go 




2. the 




3. you 


• 


4. good 




1_5. aU 




6. like 




7. make 




8. let 




9. play 




10. tow 




11. just 




12. year 




13. hrr 




14. that 




15. got 




16. cut 




17. feet 




18. show 




19. thing 




20. told 




21. noon 




22. town 




23. son 




24. cannot 




25. down 





26. found 




27. made 




28. fill 




29. became 




30. two 




31. first 




32. state 




33. round 




34. pound 




35. finish 




36. felt 




37. shut 




38. suit 




39. soap 




40. father 




41. next 




42. another 




43. know 




44. such 




45. point 




46. begun 




47. drill 




48. ticket 




49. begin 




50. again 





iay» 




vho 




inyway 




mter 




iKCk 




bus 




east 




tudy 




ourt 




>ecember 




mde 




estrain 




rorth 




bief 




Mew 




ittend 




rbole 




pend 




apid 




rait 




.vor 




upport 




Bswer 




[ectare 




onn«tion 





76. represent 




77. estate 




78. field 




79. themselves 




80. wonderful 




81. imprison 




82. entertain 




83. honor 




84. provision 




85. convention 




86. tomorrow 




87. stopped 




88. difference 




89. doubt 




90. investigate 




91. official 




92. various 




93. absence 




94. consideration 




9S. application 




96. senate 




97. principal 




98. career 




99. cordially 




100. annual 





101. it is 




102. with the 




103. five per cent 




104. for you 




105. into the 




106. ahotild be 




107. if the 




108. it will 




109. from you 




110. to take 




111. had been 




112. do not 




113. with ua 




114. to keep 




115. forua 




110. and was 




117. at our 




118. we may 




119. we shall be gUd 




120. we want 




121. about it 




122. at last 




123. we wish 




124. we resiet 




IJ5. and it U 





126. we are in 




127. who is 




128. by this 




129. wc desire 




130. if it 




131. five hundred 

thousand dollars 




132. that it 




133. if not 




134. your favor 




135. in this way 




136. at the time 




137. to send you 




138. to become 




139. of what 




140. can you 




141. you could 




142. to those 




143. and not 




144. so far as 




145. we sent you 




146. is it 




147. we trust that 




148. from which 




149. shaUhave 




150. we receive 
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TEST C-6 



L. at 




I. in 




J. wiU 




\. Uttle 




>• your 




5. six 




^ school 




}. big 




!• SC& 




). soft 




L way 




I. to 




). them 




k his 




>. north 




J. song 




7. went 




S. Monday 




). what 




). best 




I. think 




I. stay 




I. help 




k May 




>• why 





26. side 




27. said 




28. along 




29. brother 




30. they 




31. sent 




32. July 




33. cost 




34. behind 




35. hurt 




36. full 




37. easy 




38. track 




39. news 




40. anything 




41. indeed 




42. trip 




43. were 




44. many 




45. within 




46. collect 




47. army 




48. account 




49. contract 




50. infonn 
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51. member 




52. died 




53, firont 




54. prove 




55. woman 




56. sorry 




57. himself 




58. copy 




• 

59. dozen 




60. rather 




61. royal 




62. contain 




63. perfect 




64. remain 




65. between 




66. address 




67. enjoy 




68. repair 




69. beg 




70. Mrs. 




71. does 




72. reply 




73. engage 




74. firm 




75. except 





76. term 




77. remember 




78. ledge 




79. special 




80. direction 




81. written 




82. salary 




83. promise 




84. according 




85. increase 


• 


86. consider 




87. motion 




88. examination 




89. condition 




90. therefore 




91. victim 




92. decide 




93. conference 




94. colonies 




95. difficulty 




96. receive 




97. testimony 




98. height 




99. character 




100. committee 
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HITS respectfully 




wUlbe 




arMr. 




nong the 




it 




; would 




stake 




id sons 





126. wearescndingyou 




127. at any time 




128. for that 




129. you desire 




130. if they 




131. hear from you 




132. this matter 




133. in aU 




134. you want 




135. I shaU be 




136. call your attention 




137. to tell 




138. which arc 




139. on that 




140. for some time 




Ml. you're 




142. trusting that 




143. at first 




144. there will be 




145. wc should be 
pleased 




146. kindly let us 




147. will you please 




148. I don't know 




149. should not be 




150. with that 
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TEST C-6 



1. on 




2. so 




3. we 




4. ago 




5. out 




6. boy 




7. street 




8. mother 




9. day 




10. stand 




11. get 




12. I 




13. other 




14. led 




15. white 




16. winter 




17. back 




18. yet 




19. than 




20. form 




21. sister 




22. grand 




23. hard 




24. line 




25. biU 





26. kind 




27. work 




28. lost 




29. rain 




30. would 




31. mile 




32. head 




33. price 




34. around 




35. maybe 




36. fail 




37. catch 




38. watch 




39. small 




40. table 




41. four 




42. Ust 




43. dead 




44. morning 




45. done 




46. file 




47. pretty 




48. driven 




49. deal 




50. both 
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ase 




hange 




unt 




ale 




leard 




oung 




■ress 




latter 




ct 




bere 




omfort 




bjection 




gure 




scond 




ircct 




ubUc 




squest 
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wfiil 




rouble 




egree 




usband 




sgard 




blige 




oal 




gion 





76. section 




77. either 




78. claim 




79. women 




80. forward 




81. arrange 




82. visitor 




83. wreck 




84. already 




85. maimer 




86. against 




87. theater 




88. particular 




89. government 




90. too 




91. estimate 




92. entitle 




93. Wednesday 




94. assure 




95. scene 




96. respectfully 




97. discussion 




98. organization 




99. separate 




100. decision 
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101. dear sir 




102. five dollars 




103. very truly yours 




104. in your 




105. can be 




106. of course 




107. to our 




108. of it 




109. but the 




110. if you will 




111. upon the 




112. we hope 




113. I shall 




114. who have 




115. we shall be pleased 




116. in regard to 




117. if you can 




118. before the 




119. on this 




120. for which 




121. could be 




1221 it is not 




123. is that 




124. what is 




125. give you 





126. we trust 




127. I'U 




128. he can 




129. and their 




130. in fact 




131. if there 




132. to secure 




133. I should Uke 




134. and make 




135. it has been 




136. I could 




137. to which 




138. with this 




139. ought to 




140. if we 




141. yours sincerely 




142. we shall have 




143. B. & O. 




144. they would 




145. we wrote you 




146. less than 




147. within the 




148. in this matter 




149. that the 




150. years ago 





107 
TEST C-7 












at 




Id 




me 




3ok 




ty 




iree 


• 


It 




iid 




>me 




\ 




aby 




y 




>ent 




one 




vay 




nd 




s 




X 




I8t 




itside 




ice 




ft 




ant 





26. Ufe 




27. our 




28. name 




29. keep 




30. any 




31. seem 




32. story 




33. become 




34. bum 




35. across 




36. set 




37. black 




38. dash 




39. war 




40. high 




41. herself 




42. people 




43. leave 




44. however 




45. body 




46. provide 




47. stole 




48. real 




49. almost 




SO. heart 





ll\J 



TEST C-8 



1. it 




2. now 




3. my 




4. bad 




5. may 




6. by 




7. come 




8. land 




9. sit 




10. bring 




11. much 




12. send 




13. weU 




14. nine 




15. foot 




16. free 




17. paper 




18. give 




19. very 




20. gave 




21. card 




22. dark 




23. cover 




24. ship 




25. girl 





26. here 




27. more 




28. room 




29. start 




30. could 




31. even 




32. open 




33. cliass 




34. camp 




35. tonight 




36. stamp 




37. warm 




38. feU 




39. summer 




40. talk 




41. power 




42. ever 




43. early 




44. mind 




45. trust 




46. sight 




47. income 




48. recover 




49. brought 




50. month 





on the 




at the 




to make 




he wat 




maybe 




to have 




of their 




which is 




thista 




your order 




do you 




are not 




could not 




mil you 




let us 




Iwould 




ve believe 




mthat 




to ask 




Iwas 




I've 




it is not 




it has 




whidiyou 




I want 





1 26. as much 




127. in your letter 




128. I do not 




129. at the same time 




130. in ray 




131. if this 




132. to sell 




133. send us 




134. at any 




135. last year 




136. if it is 




137. you cannot 




138. you see 




139. ten days 




140. in the future 




141. at present 




142. who can 




143. did you 




144. this is the 




145. with its 




146. on the other hand 




147. your attention 




148. in time 




149. the order 




150. you will have 





101. for the 




102. we have 




103. hs9 been 




104. you can 




105. to do 




106. to us 




107. is not 




103. of these 




109. you may 




110. that this 




111. in his 




112. we cannot 




113. I can 




114. five hundred 
dollars 




115. to write 




116. that it U 




117. which the 




118. and are 




119. and brother 




120. after the 




121. I wish 




122. I will 




123. may have 




124. and our 




125. of my 





126. as they 




127. sincerely yours 




126. in addition 




129. at this time 




130. it would 




131. if you wish 




132. was not 




133. that it was 




134. at that 




135. to any 




136. in these 




137. by return mail 




138. at the present time 




139. that there 




140. in the past 




141. business men 




142. will you kindly 




143. f. o. b. 




144. to bring 




145. with reference to 




146. rather than 




147. your name 




148. is to be 




149. there's 




150. you will receive 
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TEST C-9 



1. 18 




2. man 




3. up 




4. red 




5. into 




6. have 




7. hand 




8. cold 




9. lot 




10. teU 




11. caU 




12. one 




13. about 




14. face 


s 


15. blow 




16. lake 




17. put 




18. new 




19. or 




20. aUke 




21. south 




22. band 




23. fire 




24. train 




25. part 





26. car 




27. when 




28. hope 




29. maU 




30. should 




31. without 




32. short 




33. horse 




34. bear 




35. tenth 




36. light 




37. unless 




38. fight 




39. above 




40. June 




41. wish 




42. held 




43. close 




44. shall 




45. extra 




46. stood 




47. bought 




48. mountain 




49. less 




50. children 





No. 9 







52. pkue 




53. dae 




54. death 




55. always 




56. evenins 




57. November 




58. penon 




59. among 




60. October 




61. jail 




62. fouith 




63. iintead 




64. duty 




65. ewuch 




66. through 




67. Tuesday 




68. auto 




69. earned 




70. yiot 




71. view 




72. which 




73. lEDOwn 




74. period 




75. command 





76. entire 




77. due 




78. Saturday 




79. justice 




80. attempt 




81. combination 




82. toward 




83. busy 




84. director 




85. service 




86. treasure 




87. total 




88. neither 




89. system 




90. circular 




91. accept 




92. recent 




93. folks 




94. probably 




95. circumstance 




96. majority 




97. evidence 




98. sincerely 




99. convenient 




100. recommend 





101. to be 




102. wUIbe 




103. I am 




104. we can 




105. and that 




106. of aU 




107. at once 




108. on your 




109. of vdiich 




110. of its 




111. that they 




112. as to 




113. in reply 




114. he had 




115. you will find 




116. and wiU 




117. any other 




118. for it 




119. cannot 




120. in such 




121. of tune 




122. not only 




123. the other 




124. few dayi 




125. on his 





126. in any 




127. the time 




128. in order that 




129. do so 




130. of those 




131. in the world 




132. and see 




133. to caU 




134. cannot be 




135. to their 




136. just as 




137. he cannot 




138. I can't 




139. this wU 




140. on hand 




141. for their 




142. with which 




143. five pounds 




144. to come 




145. young man 




146. the whole 




147. and also 




148. I suppose 




149. they're 




150. you wish 
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TEST C-10 



1. she 




2. ten 




3. last 




4. of 




5. him 




6. are 




7. ring 




8. hot 




9. box 




10. five 




11. long 




12. has 




13. men 




14. miss 




15. block 




16. page 




17. each 




18. letter 




19. thank 




20. add 




21. deep 




22. game 




23. age 




24. saw 




25. still 





26. word 




27. from 




28. same 




29. eye 




30. dty 




31. afternoon 




32. lady 




33. care 




34. clear 




35. sir 




36. coming 




37. clothing 




38. buy 




39. express 




40. right 




41. because 




42. church 




43. flower 




44. alone 




45. dress 




46. fix 




47. paid 




48. steamer 




49. event 




50. build 
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ise 




ture 




Ige 




m 




lething 




Q 




ject 




' 




istion 




xm 




d 




lulation 




3W 




aid 




• 




ice 




ick 




ation 








Bt 




tion 




rth 




sral 




ition 




ate 





76. preddent 




77. include 




78. appoint 




79. gentleman 




80. whose 




81. avenue 




82. success 




83. prefer 




84. purpose 




85. injure 




86. popular 




87. mention 




88. local 




89. possible 




90. argument 




91. impossible 




92. biLsiness 




93. meant 




94. foreign 




95. issue 




96. elaborate 




97. experience 




98. athletic 




99. receipt 




100. allege 





101. we are 




102. of you 




103. you will 




104. 13 the 




105. as the 




106. you have 




107. that is 




108. there are 




109. more than 




110. he is 




111. hewiU 




112. United States 




U3. ave thousand 
dollars 




114. on our 




115. we should 




116. as you 




117. I had 




118. respectfully yours 




119. in its 




120. five hundred 




121. than the 




122. thanV you 




123. that's 




124. to it 




125. from this 









126. shall be 




127. New York City 




128. to look 




129. send you 




130. has not 




131. we find 




132. it may be 




133. and they 




134. we feel 




135. from our 




136. who was 




137. of nich 




138. in this case 




139. I do 




140. under separate 
cover 




141. to believe 




142. if you do not 




143. you did 




144. for these 




145. very gUd 




146. better than 




147. to furnish 




148. as follows 




149. it must be 




ISO. to aU 


i 




ffl 



I 



\ 
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INTRODUCTION 

Some time ago the writer began work on the problem of 
constructing standard tests in typewriting, such as have been 
and are being formulated for the various subjects of the ele- 
mentary and secondary school curricula. The first prelimi- 
nary investigations, however, revealed the fact that there 
were other typewriting problems which might logically claim 
priority. First, since typewriting is a matter entirely of the 
use of the letters of the alphabet and the various marks, it 
seemed necessary to investigate the frequency of the occur- 
rence of these letters and marks in the English language. 
Secondly, since accuracy is one of the primary requisites of 
good typewriting, it appeared to be important to investigate 
the number and distribution of errors made in actual type- 
writing, and to learn, if possible, their causes. Third, the 
modern "touch" method of typewriting presumably nfiakes 
equal demands upon all the fingers and upon the two hands. 
In fact, the typewriter keyboard is so arranged as to assign 
fifteen letters to the left hand, and only eleven to the right. 
The problem arises: what are the relative abilities of the 
eight fingers and the two hands. Fourth, the determination 
of the loads or burdens of work which the present typewriter 
keyboard places upon the fingers and hands. Fifth, an at- 
tempt to enumerate the considerations which must be taken 
into account in the arrangement of a keyboard according to 
scientific principles ; a suggested keyboard, and the criticism 
of the same from the considerations set forth. 

The field of this investigation is one that has not been 
cultivated. With the exception of the work by Book on 
"The Psychology of Skill," little or no experimentation has 
been done in typewriting. Even in Book's study, the object 
was not so much the improvement of speed, accuracy or 
methods of teaching typewriting, as it was the more general 
aim of ascertaining, by the use of the typewriter as a mere 

9 



10 INTRODUCTION 

bit of apparatus, the psychology of skill. Any other mechan- 
ism, an adding machine or piano for instance, would have 
been equally capable of use in a study of skill, though per- 
haps not equally convenient for experimental purposes. 



I. THE FREQUENCY OF THE OCCURRENCE OF 
LETTERS AND MARKS IN THE ENGLISH 

LANGUAGE 

The first objective of the problem under consideration is 
to determine the frequency with which the various letters 
of the alphabet and the more common marks are used in 
the English language. For this purpose valuable material 
was readily at hand as to the letters in the form of the Ayres 
Spelling Scale. This scale itself informs us that the 1,000 
words in the list are "the product of combining different 
studies with the object of identifying the 1,000 commonest 
words in English writing." The scale was formed by com- 
bining four different vocabulary studies as follows: (1) 
A study by Ayres himself involving a total of 23,629 words 
found in personal and business letters. (2) The study of 
Eldridge comprising 43,989 words found on two pages each 
of four different newspapers. (3) The study of Rev. 
Knowles of London, of the vocabulary of the English Bible 
and various authors, to a total of 100,000 words. (4) The 
study of Cook and O'Shea of the vocabulary used by thirteen 
persons in family and social correspondence, including a 
total of 5,200 different words. Most of these words occurred 
a number of times. It will be seen, therefore, that the 
1,000 words in the Ayres Scale are those that were found 
most frequently in approximately 368,000 words of personal 
letters, business letters, newspapers, the Bible, and various 
English authors. 

Accepting the 1,000 words of this list as the most common 
in the English language, it would appear that by counting 
the frequency with which the various letters of the alphabet 
appear in these words, we should secure a very close approxi- 
mation to their frequency in the English language in general, 
and in the work done on typewriters in particular. 

11 



12 THE FREQUENCY OF LETTERS AND MARKS IN ENGLISH 

Table I shows in the first column the gross number of 
occurrences of each letter of the alphabet in the 1,000 com- 
monest words. A total of 5,433 letters were found. The 
average length of the words, therefore, is 5.433 letters. By 
multiplying the number of occurrences of each letter by 



TABLE I 

Frequency of Use of Letters in the Words of the Ayses 

Spelung Scale 





Timet Uied 


Raised to looo 


Percentage 


Bated on "Q" 


E 


734 

440 

434 

419 

385 

373 

366 

308 

254 

219 

193 

171 

170 

161 

154 

114 

113 

107 

97 

90 

60 

36 

14 

13 

5 

3 


1000 

609 

591 

571 

524 

506 

598 

420 

350 

298 

263 

233 

232 

219 

210 

155 

154 

146 

132 

123 

82 

49 

19 

18 

7 

4 


13.51 
&09 
7.98 
7.71 
7.08 
6.88 
6.73 
5.66 
4.67 
4.03 
3.51 
3.14 
3.12 
2.96 
2.81 
2.09 
2.07 
1.96 
1.78 
1.65 
1.09 
.66 
25 
23 
.09 
.05 


245 


T 


147 


R 


145 


A 


139 





128 


N 


124 


I 


122 


S 


103 


L 


85 


C 


73 


D 


64 


u 


57 


H 


56 


P 


54 


M 


51 


G 


38 


F 


37 


Y 


36 


B 


32 


w 


30 


V 


20 


K 


12 


J 


5 


X .:.:......: 


4 


z 


2 


Q 


1 



Total I 5433 



7415 



100.% 



1790 



« 



1.362 we secure the second column of the table, in which 
E" is raised to 1,000. This was done so as to put each 
letter on a comparable basis. The third column shows the 
percentage of English writing that is made up by each letter 
of the alphabet. The fourth column gives the frequency 
of the letters with reference to "Q" as one. From this 
column it will be noted that for each use of the letter "Q, 
the letter "E" occurs 245 times. 
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THE FREQUENCY OF LETTERS AND MARKS IN ENGLISH 13 

Although the evidence thus secured for the frequencies 
of letters seemed almost conclusive, it was nevertheless 
thought desirable to support it by corroborative evidence 
from original studies. With this purpose in view, three 
studies were made on the frequencies of letters and punctua- 



TABLE II 

Frequency of Use of Letters and Punctuation Marks in the 

Sixteenth Chaiter of Mark's Gospel 



Times Used 


Raised to looo 


E 


271 

164 

155 

153 

106 

92 

92 

88 

87 

67 

63 

52 

41 

37 

37 

25 

23 

23 

20 

13 

12 

6 

3 

2 

1 



19 

34 

6 

11 


1000 


T 


605 


A 


572 


H 


565 


N 


391 


s 


340 


D 


340 





325 


I 


321 


R 


247 


L 


232 


Y 


192 


M 


151 


u 


137 


w 


137 


P 


92 


c 


85 


F 


85 


B 


74 


G 


48 


V 


44 


K 


22 


Z 


11 


J 


7 


Q . 


4 


X 







70 




125 


• 


22 


• 


41 



tion marks in (1) the Gospel of St. Mark, (2) representative 
business letters, and (3) current newspaper editorials. 

Table II shows the frequencies of use of letters and punc- 
tuation marks in the sixteenth chapter of Mark's Gospel. 
The first column shows the actual occurrences of letters, 
while the second column shows the same data with "£'' 



14 THE FREQUENCY OF LETTERS AND MARKS IN ENGLISH 



raised to 1,000 for purposes of comparison. This was done 
by multiplying the first column through by 3.69. 

Table III shows the frequencies of use of letters and 
punctuation marks in actual business letters. The first col- 

TABLE III 

Frequency of Use of Letters and Punctuation Marks in Busi- 
ness Letters 



E 

A 

O 

T 

N 

S 

I 

L 

H 

K 

D 

C 

U 

M 

Y 

B 

W 

P 

G 

V 

F 

K 

X 

J 

Q 
z 



Timet Used 



Raised to looo 



354 


1000 


252 


720 


249 


711 


240 


686 


195 


557 


162 


463 


156 


446 


147 


420 


144 


411 


135 


386 


96 


274 


93 


265 


90 


260 


75 


214 


72 


205 


51 


146 


48 


137 


33 


94 


30 


86 


24 


69 


18 


51 


12 


34 


9 


25 


6 


17 


3 


8 


3 


8 


44 


124 


49 


140 


4 


12 









umn, again, shows the original data secured by count, while 
the second column shows the same data with "E" raised to 
1,000 by multiplying through by 2.82. 

Table IV shows the frequencies of use of letters and 
punctuation marks in a newspaper editorial both in the 
original form as counted and also as these data appear when 
raised to the basis of 1,000 for "E" by multiplying by 3.97. 
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A comparison of the data of these three original studies 
with Table I, which gives the frequency of letters only in 
the Ayres Spelling Scale, with the letter "E" raised to 1,000 
for purposes of comparison, will reveal much similarity both 



TABLE IV 

Frequency of Use of Letters and Punctuation Marks in a 

Newspaper Editorial 





Times Used 


Raised to looo 


E 

A 

T 


252 

219 

210 

180 

171 

168 

117 

105 

102 

99 

72 

69 

66 

57 

54 

42 

39 

33 

30 

27 

18 

15 

12 

9 

6 

3 

16 

20 



2 


1000 
876 
841 


s 


723 





685 


I 


673 


R 


468 


N 


420 


H 


409 


L 

B 


396 
289 


c 


276 


U 


263 


P 


228 


M 


216 


D 


169 


Y 


157 


w 


132 


F 


120 


G 


109 


V 


71 


K 


60 


J 


49 


X ; 


37 


Q 


24 


Z 


11 




64 




81 


1 •••••••••■•••••••• 

• 





■ 


7 



in the order or rank of the letters and in the four tables. 
It may justly be said that the differences in the four tables 
are less noticeable than the similarities. This fact may be 
given more definite and exact expression statistically. The 
frequencies of letters in the Ayres Scale correlate with the 
frequencies found by averaging the three original studies 
(Tables II, III and IV) almost perfectly. The coefficient 
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of correlation is .946 and the probable error is .012. The 
product-moment formula was used in securing this correla- 
tion. 

It is of course possible that in any one study of the fre- 
quency of letters the chance presence or absence of a few 
words containing the less common letters, such as K, J, Q, 
X or Z, may appreciably influence the result This difficulty 

TABLE V 

Studies on the Frequency op Use of Letters and Punctuation 

Marks 



Ayres 


Mark 


Business 
Letters 


Editorial 


Average 


E 


1000 

609 

571 

524 

420 

498 

508 

591 

232 

350 

263 

298 

233 

210 

146 

132 

219 

123 

154 

153 

82 

49 

19 

18 

4 

7 


1000 

605 

572 

325 

340 

321 

391 

247 

565 

232 

340 

85 

137 

151 

192 

74 

92 

137 

85 

48 

44 

22 

7 



4 

11 

70 

125 

22 

41 


1000 
686 

720 

711 

463 

446 

557 

386 

411 

420 

274 

265 

260 

214 

205 

146 

94 

137 

51 

86 

69 

34 

17 

25 

8 

8 

124 

140 

12 




1000 

841 

876 

685 

723 

673 

420 

468 

409 

396 

169 

276 

263 

216 

157 

289 

228 

132 

120 

109 

71 

60 

49 

37 

24 

11 

64 

81 



7 


1000 


T 


685 


A 


684 


o 


561 


s 


486 


I 


484 


N 


469 


R 


423 


H 


402 


L 


349 


D 


261 


c 


231 


u 


223 


M 


198 


Y 


175 


B 


160 


P 


158 


W 

F 


132 
102 


G 


99 


V 


66 


K 


41 


J 


23 


X ::::::::: 


20 


Q 


10 


Z 


9 




86 




115 


f ••••••••• 

• 


11 


• 

f ••••••••• 
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may be obviated by combining the four studies, to which 
procedure no objection may be raised in view of the very 
high correlation which obtains, as set forth above. 

Table V shows the frequencies of letters and marks in the 
four studies made, all raised to the basis of 1,000 for ''E/' 
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while in the fifth column of the table we have the average 
of the first four. This column is based on the counting of 
12,130 letters of the alphabet in connection with the four 
studies. The findings set forth in this fifth column 
are accepted in this study as a basis for evaluating 
the various letters and marks and their importance or fre- 
quency in typewriting. 



TABLE VI 

Frequency of Use of Letters and Punctuation Marks in 

Printer's Fonts as Compared With Averages 

Given in Table V 



Printer's Font 


At. this Study 


12,000 


1000 


1000 


9,000 


750 


685 


8,500 


708 


684 


8,000 


667 


561 


8,000 


667 


486 


8,000 


667 


484 


8,000 ; 


667 


469 


6,200 


517 


423 


6,400 


533 


402 


4,000 


334 


349 


4,400 


367 


261 


3,000 


250 


231 


3,400 


283 


223 


3,000 


250 


198 


2,000 


167 


175 


1,600 


133 


160 


1,700 


142 


158 


2,000 


167 


132 


2,500 


208 


102 


1,700 


142 


99 


1,200 


100 


66 


800 


67 


41 


400 


33 


23 


400 


33 


20 


500 


42 


10 


200 


17 


9 


In font of 100 "e" 






40 


400 


86 


40 


400 


115 


5 


SO 


11 


5 


50 


16 



E 

T 

A 

O 

S 

I 

N 

R 

H 

L 

D 

C 

U 

M 

Y 

B 

P 

W 

F 

G 

V 

K 

i 

Q 

z 

> 

9 



II. ERRORS IN TYPEWRITING AND THEIR 

CAUSES 

For the purposes of this part of our investigation about 
500 full size pages of practice typewriting work were secured, 
from approximately 100 different individuals, and the errors 
found therein counted and tabulated up to the point where 
"E" was charged with 1,000 errors. This point was reached 
when all but three pages of the material had been checked. 
The errors for the several letters are given in Table VII, 

TABLE VII 

Erkoes Made in Actual Typewriting as Compared With Fre- 
quency OF Occurrence of Letters 





Frequency 


Errors 


Percentage 


E 


1000 

685 

684 

561 

486 

484 

469 

423 

402 

349 

261 

231 

223 

198 

175 

160 

158 

132 

102 

99 

66 

41 

23 

20 

10 

9 


1000 

636 

596 

462 

395 

378 

372 

440 

223 

339 

418 

283 

224 

321 

246 

97 

73 

84 

209 

325 

158 

96 

26 

140 

32 

20 


100. 


T 


92.8 


A 


87.1 





82.4 


s 


81J 


I 


78.1 


N 


79J 


R 


104. 


H 


55.5 


L 


97.1 


D 


160.1 


c 


122.5 


u 


100. 


M 


162.1 


Y 


140.6 


B 


60.6 


P 


462 


w 


63.6 


F 


204.9 


G 


328.2 


V 


239.4 


K 


234.1 


J 


113. 


X ::::::::::;:: 


700. 


Q 


32a 


Z 


222.2 






Median 


108.3 



and for convenience of comparison our adopted scale of 
frequencies of use is given therewith. The percentage rela- 
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tionship between these two series of data is given in the 
third column of Table VII, from which it will be seen that 
twelve letters are as good or better than "E" from the stand- 
point of accuracy, while thirteen rank below "E." The 
median is 108.3. 

The relationship between accuracy and frequency of use 
may be definitely calculated by the use of the product-moment 
formula. The coefficient of correlation is found to be .924 



TABLE VIII 
Comparison of Frequency of Use of Letters With Accuracy 



Above Md. in 

frequency 

of use -f , 

below — , 



Above Md. 

in number 

of errors + , 

below — . 



Above Md. in 
percentage 

of accuracy -f , 
below — . 



E 

T 

A 

O 

S 

I 

N 

R 

H 

L 

D 

C 

U 

M 

Y 

B 

P 

W 

F 

G 

V 

K 

Q 

z 




+ 

+ 
+ 

+ 
+ 
+ 

+ 
+ 

+ 
+ 
+ 



+ ■ 



+ 



+ 
+ 
+ 
+ 
+ 
+ 
+ 
+ 
+ 
+ 



+ 

+ 
+ 






with a P. £. of .021. This shows a very close relationship 
between use and accuracy and bears out the adage, "Practice 
makes perfect." 

This relationship is set forth in a more graphical way in 
Table VIII. In the upper half of this table wc have the 



*The exceptiont noted are very near die mediana. 
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thirteen most used letters, in the lower half the thirteen 
least frequent letters. In the first column the frequency of 
use of letters is indicated by a plus sign for those letters 
above the median in use, and a minus sign for those 
below the median. In the second column a plus sign indi- 
cates those letters above the median in number of errors, 
and a minus sign those below the median in number of. 
errors. There are only two of the thirteen most common 
letters which are below the median in number of errors, 
and then by a very narrow margin. Also only two of the 
thirteen least used letters are above the median in number 
of errors, nor then by very large margins. In the third 
column the plus sign indicates those letters which are above 
the median in percentage of accuracy, while the minus sign 
indicates those letters which are below the median in accu- 
racy. With five exceptions out of the 26 letters, frequency, 
of use and accuracy go together, or infrequency of use with 
inaccuracy. One of the five exceptions is by a negligible 
difference. 

We had expected to find that some keys, or rows of keys, 
on the typewriter would be more accurate than others. The 
findings contradict this expectation, and indicate that the 
position of keys on the present keyboard exercises very little 
if any measurable effect upon accuracy. It has not been 
found possible to say with any degree of assurance that any 
one position on the keyboard is better than any other from 
the standpoint of accuracy. 

A further study has been made to ascertain whether the 
errors made in typing any letter are more likely to occur 
in combination with certain letters than with others. To 
answer this question errors were tabulated until 100 had 
been noted for "E," and in each case the letter after which 
the error occurred was noted. The results of this study are 
set forth in Table IX. This table should be read as follows : 
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Erbobs and the Letters Aftes Which They Occuued 

E Um. L», R12, N12. S6. T6. VS. HS, ZS, K3, F3, B3, 02, G2. 

T OtO, A9, 18, S8, N4, C4, E3, F3, B3, U3, 03. 

R E16, OIO. AIO. M4, H3, P3. 

A HIO, TIO. 04, W4. E3, D3, R2, C2, F2. M2. SI. VI. 

S ElO, A12, 14, R4, US, T2, 02, N2. B2. 

N m. A8, 08, R3. U2, 12. 

L8, R6, YS, D4, T4, G2. H2, 02. E2, W2. 

1 H6, L5, P4, W2, M2, V2, R2, K2, A2, N2. 
D E12, 08, N4, L2, V2, RI. 

L U6. P6. E4, F2, 02. A2. 12, G2, Rl. Bl. 

G Nil, E4, A4, T2, Rl. Ol. 

H W6, PS, C4. T4. 02, Al. 

M 06. 14, U2. E2. L2, R2. SI. 

U 06, R4, B3, Y2, D2, 01, HI. 

Y A6, N4. B3, T2. F2. R2, N2, H2. CI. 
C E8. A4. 12, N2, S2, Ul. 

V AS. 14. 04, N3. E2, Rl. 
W A8, S7. 

F A3, E2, 02, Nl. 

B R2, 12. M2, 01. Ul. 

K 02, R2. 12, Nl. Al. 

P H3, 12. Ul. El. 

X A3, 02, 12, El. 

Q E2. 

J A2. 

Z D2. Al. 

Tabulating from the above the errors made after each of the let- 
ters we get the following: After E 81 errors. A 81. O 75, N 46, 
R 45. I 34, H 32. L 31, M 30. T 30, S 25. U 22, P 18, B IS, W 14, 
F 12, C II, D 11, V 10. G 7, Y 7, K S. Z 5, J 0, Q 0, X 0. Inspection 
shows that this correlates very highly with the frequency of use of 
letters, which would indicate merely that most errors happen after the 
letters most frequently used because most trials occur, and therefore 
most chance for error after the frequently used letters. 

of the 100 errors made in writii^ "E," 20 occurred after M. 
14 after L, 12 after R, 12 afWr N, 6 after S, 6 after T. 
5 after V, 5 after H, 5 after Z, 3 after K, 3 after F, 3 after 
B, 2 after O, and 2 after G. It does not appear from a 
study of these data that there is any connection between 
accuracy and the combination of letters with which any one 
letter may happen to be written. This serves only to con- 
firm the conclusion that accuracy or inaccuracy is the 
result of frequent or infrequent practice, due to frequent 
or infrequent use of the letter. 



III. RELATIVE ABILITIES OF THE EIGHT 
FINGERS AND THE TWO HANDS FOR 

TYPEWRITING 

For the purpose of determining the relative abilities of the 
eight fingers and the two hands three studies were made. 
The first of these studies was made upon SO High School 
girls; the second on 46 High School boys. In those two 
studies the following method was used. The subjects were 
instructed to hold the thumb of the right hand against the 
center of the typewriter frame, in front of the space bar, and 
to tap the letter "J" with the first finger of the right hand 
as rapidly as possible. Thirty seconds were allowed. Then 
with the thumb of the left hand in the same position, the 
subject tapped with the first finger of the left hand the letter 
"F" for thirty seconds. Then in the same way, with the 
right hand second finger "K," left hand second finger "D," 
right hand third finger "L," left hand third finger "S," 
right hand fourth finger ";" left hand fourth finger "A," 
each for thirty seconds. The number of taps leaving their 
impressions on typewriter paper in the regular way were 
counted for each of the eight fingers of each of the 96 
subjects. 

The purpose of holding the thumb against the metal frame 
of the typewriter was to eliminate, so far as possible, wrist 
and arm movements, for it was desired to test only finger 
abilities. It was found that by holding the thumb in this 
position the subject was compelled to make the taps by relying 
upon the fingers alone, as was desired for the purposes of 
the experiment. The results of these two studies are set 
forth in Tables X and XI. 
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TABLE X 

Tapping Tkst on Tvpewriteb— Hich School Gikls 

Showing Nuubeb or taps Made hv Each Finger in 30 Seconds 







LsrT 


Hand 




Right 


ilHO~ 





Number of 




HilUM 


Kutcd 






Fin^M, 


uSd 




Subject 










! — 








a l''"^""T''l f 


Lctien 
1 1 k 


^uc 


; 


I 


112 


117 


120 


125 


131 


136 


113 


ISJ 


2 


122 


134 


128 


150 


117 


143 


143 


143 


3 


89 


108 


100 


96 


96 


107 


112 


108 


4 


130 


129 


139 


138 


129 


139 


143 


129 


5 


131 


12* 


93 


146 


112 


143 


133 


117 


6 


103 


135 


74 


135 


122 


136 


131 


106 


7 


121 


141 


113 


ISO 


138 


137 


144 


113 


8 


72 


63 


73 


64 


60 


64 


68 


69 


g 


115 


128 


119 


78 


151 


154 


172 


140 


ID 


84 


92 


93 


150 


98 


113 


120 


94 


11 


76 


90 


101 


77 


88 


137 


113 


100 


12 


99 


128 


128 


130 


119 


146 


151 


135 


13 


118 


122 


ISO 


140 


106 


137 


115 


100 


14 


105 


130 


129 


128 


137 


154 


165 


152 


15 


90 


106 


77 


135 


123 


138 


113 


102 


16 


93 


9S 


131 


140 


140 


138 


112 


101 


17 


74 


74 


77 


77 


76 


75 


76 


76 


18 


119 


140 


109 


120 


151 


148 


150 


159 


19 


85 


126 


113 


148 


15S 


141 


153 


91 


20 


117 


120 


119 


144 


154 


139 


136 


134 


21 


109 


116 


108 


123 


113 


119 


134 


121 


22 


91 


117 


95 


128 


103 


139 


144 


121 


23 


138 


131 


149 


131 


139 


ISl 


161 


153 


24 


76 


117 


99 


US 


101 


116 


81 


80 


25 


103 


110 


107 


t-'l 


89 


114 


127 


98 


26 


88 


102 


115 


103 


108 


109 


96 


90 


27 


88 


103 


111 


110 


107 


113 


107 


114 


28 


105 


143 


144 


137 


147 


141 


166 


156 


29 


101 


117 


138 


114 


122 


147 


1S4 


152 


30 


97 


117 


120 


90 


116 


1Z8 


134 


119 


31 


70 


92 


106 


87 


107 


105 


93 


75 


32 


81 


101 


104 


lOS 


101 


126 


113 


103 


33 


100 


119 


111 


100 


109 


116 


122 


99 


34 


112 


122 


123 


108 


141 


135 


125 


146 


35 


83 


122 


123 


88 


117 


137 


ISl 


128 


36 


84 


94 


94 


95 


84 


87 


114 


no 


37 


99 


130 


134 


124 


129 


145 


132 


154 


38 


113 


132 


128 


120 


135 


140 


143 


149 


39 


114 


104 


114 


84 


81 


113 


98 


106 


40 


110 


125 


77 


111 


126 


112 


144 


118 


41 


96 


104 


87 


96 


99 


99 


119 


112 


42 


116 


130 


128 


131 


ISO 


144 


144 


145 


43 


107 


131 


123 


111 


112 


118 


126 


127 


44 


107 


108 


112 


90 


140 


117 


105 


134 


45 


130 


128 


129 


109 


121 


138 


134 


147 


46 


108 


118 


121 


102 


119 


122 


120 


127 


47 


in 


127 


135 


12S 


121 


105 


94 


92 


48 


112 


109 


101 


96 


100 


97 


131 


134 


49 


106 


109 


117 


lOS 


120 


118 


106 


100 


50 


121 


110 


120 


111 


125 


124 


116 


110 


Averages 


103 


116 




lis 


118 


126 


126 


119 


Medians 


106 


119 


117 


119 


119 


130 


126 


117 
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TABLE XI 
Tapping Test on Tvpewb iter— High ScHwn. Boys 
Showing Numbeb op Taps Made av Each Finger i)J 30 Si 







Lbft 


Hast. 




8.CHT 


ix™ 




Number ol 

Subject 


-t 


'r- 


a 




1 1 S 1 3 1 4 




l^u^ 




■Lwlm 

i k 


'™1* 1 ; 




157 
124 
149 
105 
150 
135 
122 
129 
137 
129 
138 
139 
103 
126 

94 
ISO 

93 
181 
134 
112 
129 
112 
124 
139 
100 
121, 
148 

90 
123 
129 
114 
119 
105 
109 
134 
113 
121 
137 

11? 

142 
140 

IIS 
159 
124 
1,10 


169 
142 
154 
108 
152 
ISO 
138 
158 
130 
121 
143 
140 
126 
172 
79 
146 

lis 

186 
133 
143 
129 
128 
117 
131 
122 
134 
139 
101 
110 
131 
126 
129 
118 
99 
139 
104 
122 
135 
138 
154 
149 
151 
116 
156 
139 
129 


134 
160 
124 
117 
152 
163 
14S 
163 
193 
151 
138 
141 
125 
155 
96 
153 
136 
186 
158 
126 
143 
131 
124 
141 
139 
151 
142 
120 
128 
127 
142 
143 
155 
115 
169 
122 
139 
149 
144 
157 
169 
168 
125 
176 
141 
145 


131 

184 
163 
123 
154 
145 
126 
175 
161 
135 
140 
155 
121 
148 
94 
157 
139 
176 
168 
144 
145 
122 
132 
138 
142 
147 
165 

loe 

133 
151 
142 
139 
145 
114 
145 
114 
136 
141 
143 
151 
162 
156 
121 
16S 
149 
151 


156 

205 
150 
141 
154 
177 
166 
165 
158 
163 
139 
159 
178 
181 

179 
179 
181 
173 
141 
158 
167 
186 
157 
153 
150 
ISO 
12S 
120 
154 
16S 
140 
172 
132 
130 
151 
133 
135 
132 
151 
142 
165 
145 
199 
154 
158 


187 
217 
180 
149 
ISl 
180 
161 
153 
167 
166 
152 
146 
201 
182- 
139 
181 
176 
204 
206 
148 
164 
19S 
130 
157 
163 
163 
169 
141 
143 
174 
187 
173 
196 
132 
169 
140 
165 
178 
143 
168 
140 
183 
156 
212 
146 
155 


180 
203 
151 
138 
164 
183 
130 
183 
222 
162 
162 
152 
205 
189 
126 
190 
178 
202 
211 
168 
161 
178 
127 
173 
180 
156 
158 
142 
123 
160 
172 
160 
185 
154 
132 
136 
J6I 
146 
144 
169 
102 
169 
147 
202 
145 
154 


\K 


2 


1 52 




179 




•M 








173 


7 


m 








167 








IM 








181 




















181 








17t 


21 


169 






23 


147 








PI 








14^ 












171 




151 








171 








140 










38 


114 








150 








140 




ll' 






45 


116 


46 


,150 


Averages 

Medians 


128 
127 


134 
134 


144 

14S 


143 
145 


156 

156 


167 
166 


164 
164 


148 
ISt 
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An inspection of the medians in these two tables will 
show that the eight fingers have about the same rank and 
relative ability for the two sexes. The only noticeable sex 
difference is in speed of tapping, with respect to which the 
boys excelled the girls 24.6 per cent. 

The third study was made of 42 collie girls and 12 
teachers of Frederick County, Maryland. In this study a 
somewhat different method was pursued. The subjects were 
required to tap for one minute with a pencil with the right 
hand, then one minute with the left hand. The marks were 
subsequently counted to get the scores. (A later study 
showed that when the subjects attempted to count their taps 
as they went, their speed was impeded. A few reported that 
this served to increase their scores.) The subjects were 
further required to tap for thirty seconds upon their desks 
with each finger. Particular instructions were given as to 
the position to be assumed : with the wrist resting upon the 
desk (to prevent wrist movement in tapping) and with three 
fingers also resting with their tips upon the desk. It was 
found that this position effectually prevented any wrist or 
arm movement being used and secured records of the tapping 
abilities of the fingers alone. 

An inspection of the medians for the eight fingers in Table 
XII shows that they very closely bear out the results of 
the first and second studies as shown in Tables X and XI. 
The three studies above involve a total of 190,410 taps, 
made by 150 different individuals. It is believed that by 
combining these three studies by the method of averages, 
we may secure conclusions as to the relative abilities of the 
fingers and hands which may be relied upon. 



RELATIVE ABILITIES OF FINGERS AND HANDS 



TABLE XII 
Tapping Test — 42 College Gerls, 12 Teachus 



Number of 


T.^pc.™. 






T.P, in 


o S« 


DUdl 







ftlbjecl 


Bi«ht 


Ml 






Hud 


Hud 












1X1 






1 


355 


306 


185 


173 


159 


129 


"149 


117 


"179 


143 


2 


360 


291 


159 


138 


136 


138 


118 


110 


116 


105 


3 


446 


367 


190 


187 


161 


167 


149 


145 


143 


159 


4 


3S7 


318 


140 


143 


108 


138 


98 


98 


106 


91 


5 


443 


340 


189 


173 


159 


154 


118 


119 


124 


119 


6 


386 


350 


193 


154 


132 


123 


80 


99 


138 


119 


7 


382 


314 


183 


150 


113 


115 


121 


103 


150 


120 


8 


368 


304 


200 


173 


176 


129 


120 


94 


HO 


97 


9 


324 


175 


170 


160 


150 


141 


135 


106 


114 


106 


10 


326 


254 


163 


138 


150 


105 


65 


72 


83 


47 


11 


390 


328 


170 


149 


140 


129 


135 


109 


76 


114 


12 


387 


312 


167 


142 


140 


130 


75 


120 


112 


118 


13 


409 


299 


140 


130 


119 


117 


90 


70 


99 


94 


14 


397 


273 


153 


144 


147 


127 


85 


105 


109 


90 


15 


417 


307 


165 


140 


136 


121 


102 


101 


125 121 


16 


334 


299 


199 


170 


160 


137 


145 


144 


140 140 


17 


398 


318 


187 


136 


170 


127 


123 


117 


147 


132 


18 


359 


314 


180 


130 


101 


83 


99 


92 


71 


79 


19 


363 


286 


155 


130 


126 


110 


100 


100 


120 


102 


20 


342 


331 


146 


152 


120 


132 


116 


109 


137 


122 


21 


342 


329 


179 


165 


142 


139 


95 


98 


138 


140 


22 


400 


378 


171 


190 


156 


150 


114 


130 


141 


149 


23 


352 


330 


151 


146 


138 


125 


92 


80 


115 


101 


24 


326 


372 


130 


120 


130 


160 


100 


120 


112 


120 


2S 


343 


271 


132 


143 


126 


113 


106 


90 


130 


112 


26 


294 


289 


126 


110 


126 


111 


104 


103 


118 


lis 


27 


383 


309 


193 


160 


190 


123 


97 


107 


147 


109 


28 


367 


282 


150 


140 


149 


123 


95 


103 


111 


109 


29 


355 


265 


136 


118 


96 


94 


60 


65 


74 


71 


30 


322 


285 


142 


123 


109 


83 


100 


83 


123 


93 


Jl 


253 


291 


150 


121 


149 


130 


111 


80 


109 


103 


32 


374 


314 


101 


94 


115 


100 


78 


60 


110 


103 


3i 


407 


310 


201 


165 


157 


149 


145 


141 


162 


147 


34 


309 


226 


143 


110 


103 


64 


67 


78 


100 


92 


35 


415 


334 


201 


171 


190 


167 


173 


151 


179 


147 


36 


354 


303 


160 


136 


140 


100 


87 


90 


102 


106 


37 


363 


326 


155 


160 


132 


132 


110 


108 


108 


102 


38 


340 


346 


160 


150 


120 


120 


109 


100 


118 


113 


39 


434 


344 


170 


170 


148 


130 


106 


111 


125 


110 


40 


392 


288 


172 


136 


132 


140 


130 


123 


139 


128 


41 


317 


205 


157 


120 


139 


122 


90 


100 


122 


95 


42 


281 


280 


125 


98 


90 


82 


65 


50 


90 


75 


43 


290 


292 


150 


143 


146 


103 


60 


62 


63 


78 


44 


402 


360 


135 


121 


102 


101 


40 


80 


81 


86 


4S 


332 


340 


191 


215 


146 


160 


82 


130 


77 


102 


46 


370 


300 


150 


140 


55 


53 


75 


60 


65 


60 


47 


360 


280 


199 


142 


98 


82 


105 


100 


110 


92 


48 


400 


380 


102 


114 


117 


128 


40 


33 


103 


114 


49 


404 


342 


184 


161 


167 


149 


92 


104 


110 


103 


50 


408 


39Z 


155 


159 


ISO 


122 


102 


100 


119 


90 


51 


374 


314 


150 


118 


135 


102 


108 


94 


116 


89 


52 


314 


374 


149 


141 


164 


155 


130 


140 


150 


120 


S3 


408 


298 


123 


94 


93 


76 


15 


61 


70 


68 


54 


472 


324 


140 


115 


98 


78 


59 


60 


65 


62 




363 


310 


161 


143 


134 


12) 


101 


99 


115 


106 


Medians 


36S 


Jll 


160 


145 


138 


125 


104 


103 


117 


107 



IV. THE FINGER AND HAND LOADS OF THE 
PRESENT TYPEWRITER KEYBOARD 

Since the foregoing studies make it possible to state in a 
mathematical form the relative abilities of the two hands and 
the eight fingers, and the relative values of each letter and 
mark, it would seem worth while first to raise the question, 
what is being expected of the fingers and hands by the pres- 
ent typewriter keyboard. We are assuming, of course, that 

TABLE XIII 

The Typewriting Load of ihe Eight Fingers and the Right 

AND Left Hands 



RIGHT HAND 


Fingers 




1 


2 


3 




4 




y 


175 


i 484 


561 


P 


158 




h 


402 


k 41 


1 349 


• 
f 


16 




n 


469 


. 115 


. 86 


• 
• 


11 




u 


223 






? 


11 




• 

J 


23 






Shift 


100 




m 


198 














1490 


640 


996 




296 






Total for the right hand 


: 3422 






LEFT HAND 


Fingers 




1 


2 


3 




4 




r 


423 


e 1000 


w 152 


q 


10 




f 


102 


d 261 


s 486 


a 


684 




V 


66 


c 231 


X 20 


z 


9 




t 


685 






Shift 


100 




S 


99 












b 


160 














1535 


1492 


658 




803 



Total for the left hand: 4488 

the typewriter is to be used by a touch operator. Probably 
very few persons are any longer disposed to dispute the 
great advantage of the "touch" method for speed and accu- 
racy. Its advantage from the standpoint of fatigue is still 
greater. 
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In accordance with the touch method each of the eight 
fingers has its own proper keys, three for each finger except 
the first finger of each hand which has six. Table XIII 
gives for each finger the letters it strikes and their values, 
and the sum of these, which is the finger load. These letter 
values are taken from Table V. Denoting the fingers of the 
right hand as Rl, R2, R3 and R4, and those of the left hand 
as LI, L2, L3 and L4, we find their loads to be, in the 
same order: Rl, 1,490; R2, 640; R3, 996; R4, 296; LI, 
1,535; L2, 1,492; L3, 658; L4, 803. Adding these finger 
loads for each hand we get the hand loads : for the right hand 
3,422, for the left 4,488. In view of the fact that in Tables 
X, XI and XII we found finger abilities to be not very 
dissimilar, it is rather startling to find that Rl, LI, and L2 
are each, on the present typewriter keyboard, given more 
than five times as much work to do as is given to R4. In 
view, also, of the generally known fact that the index of 
right-handedness may be roughly expressed by the ratio of 
ten to nine, that is, that the ability of the right hand is 
approximately one-ninth greater than that of the left, it is 
surprising to find that the present keyboard gives a far 
heavier load to the weaker member. 

The question may be raised: Why are 100 strikes re- 
corded for both the right and left hand Shift Key? This 
was gotten by actual count, 200 being recorded. However, 
whether the right hand strikes exactly half of them or not 
will vary somewhat with the nature of the matter to be 
written. When a letter on the left side of the present key- 
board is capitalized the right shift key must be struck and 
vice versa. Inasmuch as most of the letters are on the left 
side of the keyboard and many of them the more frequent 
in use, it is very probable that the right shift key is the more 
frequently used. However, the total number will remain 
the same and an equal division of the total 200, while not 
entirely exact, is as near as can be gotten. 



V. THE CONSIDERATIONS TO BE TAKEN INTO 
ACCOUNT IN THE ARRANGEMENT OF AN 
IDEAL KEYBOARD BASED ON SCIEN- 
TIFIC PRINCIPLES, AND A SUG- 
GESTION FOR SUCH KEY- 
BOARD 

The several considerations which should control a scientific 
rearrangement of the typewriter keyboard are the following : 

1. The measured abilities of the eight fingers and of the 
right as compared with the left hand, should be taken into 
consideration, and loads assigned in proportion to strength. 

2. The measured frequency of use of the letters of the 
alphabet and punctuation marks must be made the basis for 
calculating the loads to be assigned to the several fingers. 

3. In addition to the above there are certain pedagogical 
considerations : 

(a) The most used letters should be assigned to the 
"home" or guide keys, since on a keyboard so arranged the 
work could be done with the fewest possible changes of 
position of hands. Also the frequent use of these letters will 
aid the pupil in the early fixing of these home-key positions. 

(b) The next most used letters should be assigned to 
those keys or positions which appear to be the favorable ones 
from the standpoint of accuracy. 

(c) Since beginners find it easier to use the first fingers 
than the other fingers, and since the approved method of 
teaching typewriting, as well as other subjects, is that of 
proceeding from the easy to the more difficult, it is desirable 
so to arrange the keyboard, by assigning several of the 
vowels to the first fingers, that simple practice words and 
sentences may be written by the beginner, even in the earliest 
stages of the learning process. 

For purposes of the first consideration, Table XIV as- 
sembles the data from Tables X, XI and XII, i. e., the 
median tapping abilities of the eight fingers of high school 
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TABLE XIV 

Comparison of Finger and Hand Abilities With the Loads of 

THE Fingers and Hands 



IrXrr Hamd RiGBT Hamd 


1 4 1 3 


2 1 1 I 1 J 1 3 1 4 Tottl 


Mds. for H. S. Girls.. io6 
Mdi. for H. S. Boys.. 127 
Mds. College Girls and 

Teachers 107 

Averages 113 


119 
134 

103 
119 


117 119 
14s 14s 

las 145 
129 136 


119 
156 

160 
145 


130 
166 

138 
145 


126 
164 

104 
131 


117 
151 

1x7 
ia8c=i046 


Multiplying these avs. 
by 7.56 to get ideal 
typewriting loads : . . . . 

The loads on the pres- 
ent keyboard are. . . . 

Percentase of over- or 
under-bad of the fin- 
gers on present type- 
writer keyboard 


8S5 
803 

—6.1 


900 
658 

1— a6.9 


975 
149a 

1 +53. 


1028 
1535 

I +49.3 


1097 
1490 

+35.8 


1096 
640 

—41.6 


991 
996 1 

+.5 


968 

396 

—69.4 



hnrt Hand 



Right Hamd 



'Dapping ability (190,410 taps by 150 
individuals) 



Present load 

Per cent of over- or under-load. 



89.593 <BP» 
Ratio: 88.87 

4.488 taps 
Ratk>: 131.25 

47.7 

(over-load of left 
hand as compared 
with right) 



100317 taps 
to xoo 

3,432 taps 
to xoo 



girls, high school boys, and coll^[e girls and teachers, com- 
bining the three by the method of averages and showing a 
total of finger abilities of 1,046. Table XIV also includes 
the present keyboard load from Table XIIL Dividing the 
total keyboard load (7,910— the sum of 3,422 and 4,488 of 
Table XIII) by the simi of the finger abilities (1,046, Table 
XIV) we find that each point of finger ability must be multi- 
plied by 7.56 so as to reapportion the whole load upon the 
fingers in proportion to their abilities. Comparing the ideal 
finger loads with the present finger loads, we find four over- 
loads of 49.3, 53., 35.8, and .5; also four under-loads, 5.1, 
26.9, 41.6, and 69.4. 

Of the 190,410 taps made in this study, 100,817 were made 
by the right hand, and 89,593 by the left, in equal time- 
Therefore the ratio of the ability of the right hand to that 
of the left is as 100 to 88.87, or approximately as ten is to 
nine. This agrees with the findings of Bryan.* The present 



*Bbyan, American Journal of Psychology, 189a, V, 123-204. 
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right and left hand loads in typewriting are 3,422 taps for 
the right to 4,488 for the left, or a ratio of 100 to 131.25. 
These data show an overload of the left hand of 47.7 per 
cent as compared with the right hand, on the present type- 
writer keyboard. The over-loads and under-loads discov- 
ered are more graphically shown in Figure 2. 

The criticism might perhaps be advanced that in combining 
the measures of the tapping abilities of the several fingers 
as obtained on the typewriter, with those obtained in tapping 
on desks, two different, and for all we know, heterogeneous 
sets of data are being added together. In reply to this sug- 
gestion the following considerations are advanced and need 
to be taken into account. 

First, it should be borne in mind that the same purpose 
was uppermost in these two sorts of experimentation, namely, 
the attempt to get a mathematical statement of the com- 
parative abilities of the several fingers. The two experi- 
ments are alike in that both attempt to secure an accurate 
count of the number of taps each finger can make in the 
same period of thirty seconds, or of one minute. 

Second, it is true that tapping on a desk is not, so far as 
we know, the same thing as tapping the keys of a tjrpewriter 
in the ordinary use of that machine. But it is also true that 
tapping the keys of a t3rpewriter under the controlled situa- 
tion, namely, with the thumb touching the frame of the 

machine, beneath the space bar, may, for all we know, be 
no more like the process of actual typewriting than is tapping 
on a desk as described above. In fact, it may be that the 
former more nearly approximates the actual process involved 
in typewriting than does the latter. Both are controlled 
situations, with the purpose of preventing an undue influ- 
ence upon the outcome as a result of leaving the arm and 
wrist free to do the tapping, instead of compelling the fingers 
to do it. 

Third, of the three sets of data which are combined in 
Table XIV, the third (the results of tapping on desks) does 
not differ more from either the first (the results for high 
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school girls tapping on typewriters) or the second (the 
results for high school boys tapping on typewriters) than 
the first differs from the second. Therefore, an argument 
against including the third, because it differs from the first 
and second, would be just as good an argument, so far as it 
goes, for excluding either the first or second because it differs 
from the other. 

Fourth, the average scores for the fingers secured by com- 
bining the three sets of data in Table XIV differ from the 
scores which would have been secured by combining only 
the two first sets of data of that table by only a little over 
four per cent. So far as the relative abilities of the two 

TABLE XV 

Comparison of Finger-loads of Standard and Proposed Keyboards 

With Ideal Loads 





Ltrr Hand 




Right Hand 






Pingtrs 


Fingers 




4 


3 


a 


I 


X 


a 


3 


4 




V 


D 


M 


c w 


Q F 


v 


L 


P 




R 


N 


T 


H U 


S I 


E 





A 




B 


P 


G 


J X 


Z ? 

/ 


• 
• 

• 
• 


• 


» 
* 


Load on above 
keyboard .... 


858 


888 


98a 


1031 


1098 


X093 


996 


971 


Ideal load . . . 


8SS 


900 


975 


ioa8 


1097 


1097 


991 


968 


Load on present 
keyboard .... 


803 


658 


1492 


1535 


1490 


640 


996 


296 



hands are concerned, the three sets of data agree, all giving 
the ratio of approximately ten to nine. This larger result 
is therefore unaffected by the inclusion or exclusion of the 
third set of data. A study of the suggested keyboard 
(Table XV) will reveal the fact that it was found impossible 
so to assign loads as to give each finger exactly the proper 
amount of work. In the case of the third finger of the left 
hand the error amounts to as much as one and one-third 
per cent. In view of this fact the above mentioned difference 
of four per cent loses much of its significance. 
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Fifth, the fact is generally known, especially among 
pianists and typists, that the third finger is the least capable. 
This fact is not so clearly revealed in the first two sets of 
data of Table XIV as in the third. This may perhaps be 
explained by saying that the third finger, in the case of the 
experiment on the typewriter, being further removed from 
the fixed point, the thumb, than was the first or second finger, 
was perhaps aided somewhat in its tapping by the movement 

TABLE XVI 
The Accuracy of Horizontal Lines of Keys on Typewriter 



Upper 


Line 


Middle Line 


Lower Line 


Rank 


i of 


Rank i of 


Rank 


i of 


in use 


errors 


in use errors 


in use 


errors 


Q 25 


320 


A3 87 


Z 26 


222 


W 18 


64 


S 5 81 


X 24 


700 


E 1 


100 


D 11 160 


C 12 


123 


R 8 


104 


F 19 205 


V 21 


239 


T 2 


93 


G 20 328 


B 16 


61 


Y 15 


141 


H 9 56 


N 7 


79 


U 13 


100 


J 23 113 


M 14 


162 


I 6 


78 


K 22 234 






O 4 


82 


L 10 97 






P 17 


46 








Averages.. 10.9 


112.8 


13.6 151.2 


17.1 


226.7 



Comparison of the Rank of the Eight Fingers and the Hands 
in Accuracy and in Load in Typewriting 

v:«<MM.. Rank in Rank in 
Fingers Accuracy Ix^d 

( 1 3 6 

Right hand ];;;;;;;;;;;;;;;; f I I 

^v^v^\v^v^v/^'^]y^'^'^ 4 i i 

1 6 8 

;!;;!;;;;!!!!!!;!!!!!!!!!!! 3 8 3 

4 7 4 

Right hand 108% of errors 3422 

Left hand 192% of errors 4488 

of the wrist and arm. Should this explanation be the correct 
one, it would appear that the third experiment avoided this 
chance for error, and is to that extent a corrective. It is the 
opinion of the writer that the inclusion of the third set of 
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data in the averages gives a truer estimate of the abilities 
of the fingers than would be the case were these data omitted. 
To return to the considerations which must be taken into 
account in arranging a keyboard along scientific lines, it was 
noted as one of the pedagogical considerations that the eight 
most frequently used letters should be assigned to the home 
keys, so far as this may be found to be possible without 
overloading of fingers. Also, that several of the vowels 
should be assigned to the first fingers, for the reason stated. 

TABLE XVII 

The Accuracy of the Eight Fingers in Typewriting 

(Percentages) 





RIGHT HAND 










Fingers 1 


2 




3 




4 


y 141 
h 56 
n 79 
u 100 
j 113 
m 162 

Averages.. 108 


i 78 
k 234 

« 

156 


o 
1 

• 


82 
97 

89 


P 


46 
46 


Average for the right hand: 


108 






left hand 


Fingers 1 


2 




3 




4 


r 104 
f 205 
v 239 
t 93 
g 328 
b 61 

Averages.. 172 


e 100 
d 160 
c 123 

128 


w 
s 

X 


64 

81 

700 

282 


q 

a 
z 


320 

87 

222 

210 



Average for the left hand: 192 

From the consideration of accuracy two results might 
follow. It might be found that for certain vertical rows of 
keys, or the fingers assigned thereto, there was greater accu- 
racy, or that for certain horizontal rows there was more accu- 
racy than for others. These two possibilities are studied in 
Table XVI. In the upper half of this table accuracy is com- 
pared with frequency of use for each of the horizontal' rows 



38 AN IDEAL KEYBOARD 

of keys. In Table VIII we show that, with reference to 
the individual letters, accuracy and frequency of use arc 
almost perfectly correlated. Table XVI, however, seems to 
show that we have the greatest accuracy in the upper hori- 
zontal line, with decreasing accuracy in the middle and 
especially in the lower lines^ to an extent that is not justified 
by use or disuse. Since this is the case, it will be well to 
assign, the more frequently used letters, after the home keys 
have been supplied, to the upper row of keys. 

The second part of Table XVI, on the other hand, shows 
differences in accuracy of fingers, that is, of vertical rows 
of keys. The accuracy data are taken from Table XVII. 
But while the accuracy of fingers seems to differ, it appears 
from the table that this is due to the loads assigned to the 
fingers and hands, rather than to qualities of the fingers 
or hands themselves. For when the fingers are given their 
rank for accuracy and for load, we find a close correlation. 
The overloaded fingers tend to be inaccurate. In the case 
of the two hands the evidence is even more clear. 00)^ right 
hand with the smaller load has the better accuracy scored 
The average frequency of use of letters written by the left 
hand on the present keyboard is 291, by the right 280. So 
far as the law of use goes, the left hand should be four 
per cent more accurate than the right. Instead of this we 
find the right hand 84% more accurate than the left. This 
must be due to the over-load of the left han^ 

This evidence tends to show that nearly half of the errors 
made by the left hand in typewriting are preventable, since 
they are due to the bad apportioning of the typewriting load 
on the present keyboard. 

A further important reason why the typewriter keyboard 
should be scientifically rearranged is the self-evident fact 
that maximum speed and ease of operation can never be 
attained so long as some fingers are over-worked, while 
others do not have a chance to contribute their full share 
to the total result. 
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A rearrangement of the keyboard will, it is clear, make 
for improved speed and accuracy in typewriting. 

The present standard arrangement of the typewriter key- 
board antedates the. "touch" method of operating, which has 
come to be the only accepted method in the teaching of type- 
writing. Therefore the considerations, if any, which sug- 
gested the present arrangement of the keyboard, do not apply, 
but new considerations must be brought to bear which take 
account of the fact that all of the fingers are to be used 
and should contribute their share, no more and no less. 

In accordance with the above considerations we offer the 
preferred rearrangement of the letters and marks of the 
typewriter keyboard shown in Figure 3. 

In addition to the improvements in the arrangement of 
the typewriter keyboard based on the investigations and 
considerations hereinbefore set forth, Figure 3 shows certain 
other changes from the conventional arrangement which 
remain to be explained. These changes are (1) the inter- 
posing between the right and left banks of keys of the shift 
lock, shift, and back spacer keys, and (2) the placing of 
the margin and tabular keys in the lower horizontal row of 
keys, one at either end. 

In general, it may be said, first of all, that both these 
changes are made in an effort to make the keyboard arrange- 
ment more compact, thereby bringing all keys within reach 
of the fingers without unnecessary hand movements. These 
keys are, for the most part, usually so placed on the t)rpe- 
writer as to require the operator to remove the fingers from 
the letter keys. Furthermore, the shift key, shift lock, and 
back spacer are the heaviest keys on the typewriter. The back 
spacer operates against the tension of the machine and is prob- 
ably the heaviest key of all. The shift key and shift lock 
usually lift either the carriage or the basket of keys. In 
either case, the operation of these keys requires far more 
force than the operation of the letter keys. It is felt, there- 
fore, that these three keys should be placed in a central 
position, as in Figure 3, so that they may be operated by the 
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thumb or first finger, rather than by the fourth finger, whose 
strength is scarcely adequate. The margin release and tabu- 
lar key are very light in touch, and not often used, so that 
in assigning them to the fourth fingers, as in Fig. 3, we are 
not unduly burdening these weak fingers. 

The advantages of this arrangement are: 1. The keys in 
question are brought into a convenient position for operation 
by the thumb or first finger of either hand. 2. The entire 
keyboard can be operated without removing the hands from 
the position they take when the fingers are placed upon the 
"home keys," as the keys of the middle horizontal row of 
letters are called in touch t)rpewriting. 3. The interposition 
of the shift, shift-lock and back spacer keys divides the 
keyboard into right and left halves, thereby tending to avoid 
errors and undesirable hand movement resulting from the 
encroachment of one hand on the territory of the other. 4. 
The interposed keys accentuate the importance and make 
necessary the confining of each hand to its appropriate bank 
of keys, with a minimum of movement for complete perform- 
ance of the entire duty assigned it. These four advantages, 
together with all the other advantages claimed for the key- 
board as shown in Figure 3, may be summed up, in a general 
way, by saying that this keyboard is definitely planned for the 
most accurate and economical operation by the touch method, 
the method which is now being taught in practically all 
schools, whereas the present conventional, so-called standard 
and universal keyboards have been arranged with reference 
to no discoverable or known criteria whatsoever. 
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CHAPTER I 
The Place of Interest in Education 

The modem concept of interest arose in the eighteenth 
century and found its first proponent in the person of Jean 
Jacques Rousseau. However, since no new concept is free 
from indebtedness to the past, it may be of value to sketch 
briefly the development of earlier cognate ideas. The earliest 
of these is the contribution of Aristotle. In his effort to solve 
the problem arising from the contest between individual in- 
terests and social welfare, he set up happiness as the goal of 
life. Explaining happiness as the result of goodness, he 
showed that the latter is twofold in its nature, consisting of 
well-being and well-doing. By well-being, he refers to indi- 
vidual development and welfare. For instance, he advocates 
the inclusion of music in the curriculum because it is an 
amusement. The recognition of individual differences was 
more explicit among the Romans than among the Greeks. 
Quintilian objects to the disciplinary use of physical force and 
insists that the studies should be made attractive. The follow- 
ing quotations from his " Institutes of Oratory " will serve 
to make his position clear: " Let his (the pupil's) instruction 
be an amusement to him." ^ " Let him that is skilled in teach- 
ing ascertain first of all, when a boy is entrusted to him, his 
ability and disposition."" Elsewhere Quintilian claims that 
character should be the end of education and emphasizes 
the fact that the teacher should respect the individuality of 
the child. 

The next educator, whose ideas and practices are of interest 
from our present viewpoint, is Vittorino da Feltre (1378- 
1446). He aimed to make the life of his pupils as attractive 
and as full of activity as possible. Monroe admirably sums 
up his practices in the following words : " Self-government 

* Watson, 1891, vol. i, p. 14. 
■ Watson, 1891, vol. i, p. 25. 
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by the boys of the school, a dependence upon the natural 
interests of the pupil, use of the natural activities of the child 
as a basis for much of the work, and a strong emphasis upon 
activities and upon the constructive side of the work as fur- 
nishing an immediate introduction into a useful life, were 
some of the features exemplified in this school at Mantua." * 

A century after Vittorino, another educator, Rabelais 
(1483- 1 553) advocated similar ideas. He urged that school 
studies be made pleasant and suggested that games and sports 
be included in the school activities. On the whole, his pro- 
posals are largely a repetition of those made by Quintilian 
and Vittorino. 

The pre-Rousselian ideas of interest are essentially differ- 
ent from the modern concept. They imply the attachment 
of pleasantness to the woiic by the application of external 
means. They seek to amuse the child, to assiu-e him of a 
pleasant time in school. This is very different from our 
present dynamic conception of interest wherein it means 
identification of the learner with the material to be learned. 
In modem school procedure, interest is the motivating power 
that drives to accomplishment. 

Rousseau (1712-1778) broke away sharply from his prede- 
cessors. He proposed that the interest and curiosity of the 
child should be used as the motive for study. Rousseau 
would have the whole education of the individual based upon 
his own natural interests and determined by his inherent 
capacities and tendencies. To him the value of any educating 
lay in the interest aroused in the child. True education, being 
development from within, can be attained only through the 
working out of natural interests and instincts. Hence, Rous- 
seau was a vigorous opponent of the application of external 
force as a means of educating. His ideas initiated the con- 
flict between the " education of interest " and " the education 
of effort " that has not yet been settled to everyone's satis- 
faction. Basedow (1723-1790) introduced Rousseau's doc- 
trines into Germany. His goal was " education according to 

* Monroe, 1908, p. 377. 
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nature " and he sought to intrigue the interests of the children 
both by the content of his curriculum and by his methods 
of teaching. 

Pestalozzi (1746-1827) took over many of the ideas of 
Rousseau and Basedow and worked them out more fully. 
He considered education as the continuous development of 
the mind and this development as dependent upon suitable 
exercises being provided. He pointed out that the child 
develops mentally only through his own activities and that 
these activities are most important when they are the outcome 
of the child's spontaneous desires. It is such activities that 
lead to growth and the direction of growth is determined by 
the original nature of the particular child. 

The importance of interest as the motivating power of 
education had increased rapidly in pedagogical circles from 
the days of Rousseau onward. In the case of Herbart ( 1776- 
1841 ) it became the cornerstone of the educational edifice that 
he attempted to rear. He based his work upon that of 
Pestalozzi, extensively developing it and adding many con- 
tributions of his own. With Herbart, a definite doctrine of 
interest first appears. Thus, while the germs of the doctrine 
are found scattered through the centuries, the doctrine itself 
first finds forceful and adequate expression in the nineteenth 
century. Herbart claimed that the ultimate end of education 
was virtue, but that this final aim could be realized only 
through setting a nearer and more practical goal. This latter 
one he called many-sidedness of interest; around it his chief 
contributions center. He says : " The word interest indicates 
in general the sort of intellectual activity which instruction 
should cause, since it cannot arise from mere knowledge. For 
one regards mere knowledge as a store which might indeed 
be lacking without a man being in any way different on that 
account. On the other hand, he who has a firm grasp of his 
knowledge, and seeks to extend it, is interested in it. Since, 
however, this mental activity is varied, we need to add the 
further determination supplied by the term " many-sided. 

* Monroe, 1908, p. 633. 
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In the " Science of Education " he says : " In one word, the 
aim of education is subdivided according to the aims of choice 
— ^not of the teacher, nor of the boy, but of the future man, 
and the aims of morality." * " How can the teacher assume 
for himself beforehand the merely possible future aims of the 
pupil ? " *' Every man must have a love for all activities, 
each must be a virtuoso in one. But the virtuoship is a 
matter of choice; on the contrary, the manifold receptivity 
which can only grow out of manifold beginnings of one's own 
individual efforts, is a matter of education."* To bring 
about this manifold receptivity he proposes the development 
of many-sidedness of interest — proportionate many-sided- 
ness. This will tend to make the individual sympathetic 
toward the interests and activities of others, and give him a 
starting-point from which to develop his own main life 
interest. Herbart says that knowledge and sympathy are the 
two primary divisions of interest. His classification of in- 
terests follows: 

Interest 
in knowledge in sympathy 

1. Empirical interest. i. Sympathetic interest. 

2. Speculative interest 2. Social interest 

3. Aesthetic interest. 3. Religious interest 

The attainment of the perfect many-sided culture of the 
mind depends upon these six kinds of interest having been 
placed in balanced action. 

Herbart links interest and apperception closely. ^In fact, 
he defines interest as the mental activity or condition that 
accompanies apperception. The principle of aj^rception 
leads us straight to child study. The teacher is obliged to 
inform himself of the child's previous knowledge and in- 
terests in order that he may use them as the basis of further 
instruction and learning. 

The remarkable development of the doctrine of interest 
during the nineteenth century cannot be fully appreciated 
unless we give some consideration to the contributions of 

* Herbart, p. 109. 
"Herbart, pp. iio-iii. 



THE PLACE OP INTEREST IN EDUCATION 5 

Froebel (1782- 1852). He maintained that real education 
must take its roots in the spontaneous activity of the child 
and must eventuate in enduring volitional interests. He held, 
as worthy subject-matter of instruction, only that material 
which comes from life, and from life only in so far as it enters 
the experience of the child. Thus, Froebel's plan of educa- 
tion is definitely based upon a utilization of the child's 
interests and capacities. 

The recognition of interest as a determinant in educational 
practices did not occur in America until toward the middle 
of the nineteenth century. This recognition first appeared 
in the sphere of higher education. As early as 1825 the 
University of Virginia had been established with the avowed 
policy of permitting complete freedom of choice on the part 
of the students. Such freedom began to wedge its way 
gradually into Harvard from 1845 on. Upon his inaugura- 
tion as president of that institution in 1869, Dr. Charles W. 
Eliot granted the students complete freedom in the election 
of subjects. Cornell University had been established upon the 
basis of complete freedom two years earlier. These striking 
and pioneer efforts were soon imitated by other American 
institutions of higher education. 

After Herbart's death, his doctrines were extended, worked 
over, and crystallized by his followers in Germany and had 
a pronounced effect upon educational content and method in 
that country. At about 1890 the movement was transported 
to the United States where it flourished vigorously for a 
while and brought about thorough-going and lasting changes 
in educational practice. Frank McMurry, Charles McMurry, 
and Charles De Garmo were the leaders of the American 
Herbartian movement. In 1902, De Garmo wrote a book 
entitled " Interest and Education " in which he endeavors to 
make a concrete application of the doctrine of interest to 
practical, class-room education. A few of his argtunents 
may be stated in brief here. He says : " May it not be that to 
establish desirable permanent mental attitudes toward men 
and their institutions and toward nature and her living 
creatures is one of the choicest opportunities, not to say most 
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imperative duties of the school? " * " We may say in general 
that interest is a feeling that accompanies the idea of self- 
expression. . . . Interest is therefore dynamic in character."* 
He distinguishes between clear and vivid ideas, indicating 
that while the former tend to produce only inner illumination, 
the latter tend ever to pass into action and are the source of 
genuine interest. What is an object of interest to one person, 
may have no effect whatever upon another. Hence, elective 
studies must be provided if the varied interests of the indi- 
vidual pupils are to be appealed to. Urban conditions neces- 
sitate abtmdant motor activities if the worth-while interests 
of the child are to be met. De Garmo urges that methods of 
instruction should be based upon the interests and potential 
interests of the pupils. He advocates concreteness in instruc- 
tion in order that there may be fertile ground for the 
development of vivid ideas. Above all, he proposes a utili- 
zation of interest as a means of securing real thinking on the 
part of the pupil. This proposal refers to the problem 
method, which serves as a natural transition to the contribu- 
tions of John Dewey. 

Dewey has contributed more than anyone else to the har- 
monization of interest and effort. He organized an experi- 
mental elementary school at the University of Chicago in 
1896 and conducted it for seven years. The core of his educa- 
tional theory is, to a large extent, the experience he gained 
there while applying the psychological principles that he had 
worked out. The basis of all his theorizing is that " the school 
cannot be a preparation for life except as it reproduces the 
typical conditions of social life." Perhaps his most important 
contribution to education has been the " problem method '* 
of teaching and learning. He has shown that induction and 
deduction do not include the entire intellectual process. In the 
words of Duggan, "Professor Dewey has pointed out that 
these are the thought-processes only of one who has already 
through experience mastered the subject-matter of his field, 

* 1908, p. VIII. 

• 1908, pp. 18-19. 
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and that by far the greater part of our intellectual process 
is antecedent to this stage. We must, therefore, study these 
antecedent processes by which the mind of the individual 
comes into relation with the objective world, and find in them 
the methods for the greater part of our teaching. Professor 
Dewey finds the characteristic feature of them to be 'in- 
terest,' by which he means a more or less conscious and 
partly instinctive desire of the individual to attain some end. 
But interest is to be considered only a stimulus to the higher 
intellectual processes, into harmony with whose workings the 
teacher must bring his schoolwork." * In his book entitled 
" Interest and EflFort," Dewey makes a successful attempt to 
harmonize the " education of interest " with the " education of 
eflfort." He proves that neither theory is satisfactory, but that 
both contain parts of a larger truth that will function. " The 
genuine principle of interest is the principle of the recognized 
identity of the fact to be learned or the action proposed with 
the growing self ; that it lies in the direction of the agent's 
own growth, and is, therefore, imperiously demanded, if the 
agent is to be himself. Let this condition of identification 
once be secured, and we have neither to appeal to sheer 
strength of will, nor to occupy ourselves with making things 
interesting."* This quotation gives his proposed remedy. 
When a suitable problem (that is, one that meets his present 
needs) is set before the child, it enlists his interests and effort 
naturally arises in his attempt to satisfy these interests. In 
Dewey's words, *' Interest means a unified activity." ' Interest 
is of value only when it brings about growth, or development. 
There are times when interest in some distant end works its 
way back into the means which would otherwise be either 
colorless, or even distasteful in themselves. Dewey notes 
four types of educative interest: (i) physical activity; (2) 
constructive activity; (3) intellectual activity; and (4) social 
activity. To Dewey, interest is fundamentally identification 

• Duggan, 1916, pp. 321-322. 

• Dewey, 1913, p. 7. 

• Dewey, 1913, p. 15. 
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of the learner with the matter to be learned. In ** Denxxxacy 
and Education " he writes : " In fact, self and interest are two 
names for the same fact; the kind and amount of interest 
actively taken in a thing reveals and measures the quality of 
selfhood which exists." * 

Modem psychologists have given much attention to in- 
terest. Only a few whose contributions have been most 
significant may be considered here. William James con- 
sidered interest as probably the most important element in 
the determination of a man's mental efficiency. He showed 
how through proper association interest may be created in 
new objects of thought. He explained how, growing out of 
each other, the interests of the child are gradually built up 
until, when he becomes an adult, most of his interests are 
exceedingly artificial. The importance of the investigations 
of G. Stanley Hall and his followers in arousing interest in 
child-study cannot be overestimated. A number of their 
studies deal with the interests of children. These investigators 
concluded that different interests develop at different times 
and they endeavored to locate the natural periods for the out- 
cropping of the more important groups of interests. Such 
investigations led to important changes in educational pro- 
cedure and administration in this cotmtry. The most signifi- 
cant of these changes has been the inception and develop- 
ment of the junior high school. Study of the interests and 
capacities of the children of early adolescence led to the 
belief that children should have, during that period, a type 
of education suited to their own peculiar needs and, there- 
fore, different from that provided in the elementary school 
and likewise from that offered in the secondary school. Edu- 
cators began to realize that this must be largely an exploratory 
period. The pupils' individual interests must be respected 
and the opportunity to choose must be provided earlier tfian 
in the high school. The junior high school is thus an objective 
recognition of children's interests and a serious effort to 
adjust education to those interests. 

* Dewey, 1921, p. 408. 
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Arnold has made a careful study of interest from the psy- 
chological point of view. He defines interest as " an attitude 
taken towards a situation, and characterized (i) by motor 
tendencies and feelings of expectation, anticipation, and 
strain, (2) by meaning implicit in the situation or by free 
images and ideas, and (3) by a reference of attitude and 
ideal content to some future condition of the self." ^ Thus, 
he recognizes both the motor and ideal aspects of interest. 
The kinds of interest are classified as : (i) curiosity, (2) ex- 
pectation, and (3) conscious desire. The three stages of inter- 
est are (i) primary, (2) secondary, and (3) acquired. In 
primary interest, the situation leads directly to pleasure or 
satisfaction. Secondary interest is interest in means because 
they are connected with an end that will provide pleasure or 
satisfaction. These means may eventually come to be inter- 
esting on their own account ; that would represent acquired 
interest. All stages of interest may be either positive or 
negative. 

Kitson has investigated interest as a criterion in vocational 
guidance. The following statements summarize his findings. 
There are two methods of investigating interests: the 
" method of expression " and the " method of impression." 
By the former method, various devices are used to measure 
involuntary changes in pulse-rate, blood-voltune, and res- 
piration and the effort is made to relate the results to feel- 
ings of interest. This method is of no real value in voca- 
tional guidance. The " method of impression " is the ques- 
tionnaire method. Kitson is uncertain as to the value of this 
method. He concludes : *' All the evidence shows that the 
use of interest as a means of directing vocational guidance 
is beset with many difficulties. They have to do with methods 
of investigation, with the fact of dearth of interests and the 
multiplicity of interests, with the fact that interests are un- 
stable, evolving things, and finally, with the fact that interest 
is not always associated with capacity. Taken together, the 
difficulties constitute a formidable group of obstacles. They 

^ Arnold, p. 224. 
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are not unsurmountable, however, if one takes the proper 
view toward interest. A theory of vocational guidance that 
regards it as the basic criterion is wrong. It should rightfully 
be r^^ded as only one criterion and not at all as the sole 
or invariably decisive factor. Indeed, no single criterion is 
adequate for the giving for vocational advice." * 

Later Kitson developed a new phase of the problem in 
an article entitled " Economic Implications in the Psycho- 
logical Doctrine of Interest." He points out its possible sig- 
nificance for the processes of marketing, labor management, 
and vocational guidance. Interest is defined as " the recog- 
nition of a thing which has been vitally connected with 
experience before — 3, thing recognized as old " and that which 
*' naturally arouses tendencies to act." He discusses two prac- 
tical principles of the doctrine of interest: (i) '' Interest in a 
thing may be developed by means of extending information 
about it ; " and (2) " Interest in an object may be developed 
by arousing motor activity in its behalf." * While the writer 
makes no attempt so to apply them, there is no doubt that both 
of these principles may be profitably employed in the treat- 
ment of vocational interests. 

Very few experimental studies of interest have been made. 
Van Denburg, in studying the causes of the elimination of 
high school pupils in New York City, tabulated the voca- 
tional interests of entering high school pupils. He fotmd that 
41)^ of the boys and 51;^ of the g^rls had made no choice. 
The definite choices were scattering. King made a com- 
parable study of Iowa high school pupils. He found that more 
than three-fourths of the pupils in all grades of the high 
schools studied had made definite vocational choices. He 
attributes this higher percentage to the fact that the early 
part of the high school work in Iowa affords opportunity for 
the discovery and cultivation of interests. Sears tabulated the 
vocational interests of the boys of grades seven and eight of 
the Oakland schools in 191 5. He found that 88j< of them 
made definite choices. 

* Kitson, 1916. 
' Kitson, ig20. 
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In 1913 Thoradike had some college students list a number 
of school subjects in the order of their preference therefor 
and later in the order of their ability therein at three different 
periods: (i) last three years of grammar school; (2) high 
school period; and (3) collie period. He got remarkably 
high correlations between interest and ability. Of course 
this study is of suggestive value only. The fact that the 
preferences of the first and second periods were not the real 
preferences of those periods, but preferences as remembered 
some years later renders the actual results highly unreliable. 
Thomdike concludes that: (i) There is considerable per- 
manence of pupils' interests; (2) that there is an equal per- 
manence of pupils' abilities; and (3) that pupils' interests 
are highly indicative of their abilities. 

Bridges and DoUinger carried on an investigation to check 
Thorndike's conclusion that pupil's interests are highly indic- 
ative of their abilities. College pupils ranked their studies 
in accordance with their interest and later in accordance with 
their estimated ability. These records were kept and corre- 
lated with the actual marks made for the semester. The in- 
terests correlated with the actual marks to the extent of .25 ; 
the estimated ability correlated with the marks to the extent 
of .28; the rank in interest correlated with the rank in 
estimated ability to the extent of .57. Therefore, they con- 
clude that "a person's relative interests are an extraor- 
dinarily inaccurate symptom of his relative capacities." * 

It must be held in mind that when they speak of capacity, 
they mean simply capacity in so far as it is revealed by college 
marks. They suggest that interest and ability must somehow 
be measured separately. 

A. R. Crathome investigated the vocational interests of 
2000 collie freshmen in a number of institutions. His pur- 
pose was to study the change of mind that takes place between 
entering high school and entering college. The students were 
asked to state : Whether they had a definite vocational interest 
on entering high school ; whether they had such a definite in- 

' Bridges and Dollinger, 1920, p. 313. 
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terest on entering college ; if so, to name it ; and, whether it 
had changed during this period. He found that on entering 
high school 57^ had decided upon their life work. By the time 
they reached college almost exactly 50$^ of these had altered 
their choices. 85^^ of the students had arrived at definite voca- 
tional interests by the time that they entered coU^e. Cra- 
thome's data are open to the same criticism that was made of 
Thomdike's and their possible value is discounted ^^reatly 
thereby. With regard to the early interests, it deals, not with 
the real interests, but the interests as remembered four years 
later. 

Proctor has studied the vocational interests of a group of 
high school students over a period of four years. There were 
six hundred eighty-three students available at the end of 
this period. Two hundred seventy-two were engaged in 
occupations and two hundred ninety were pursuing work in 
educational institutions beyond the high school. Of the two 
hundred seventy-two in vocations, only 40j< were engaged 
in occupations of a rank equal to or higher than that indi- 
cated in their original preference. Proctor * noted a tendency 
for the children of less than average intelligence to gravitate 
to the lower occupations. The median I. Q. of the pupils who 
had gone on in school was one hundred fifteen ; that of those 
in occupations was one hundred five. 

Thomdike has recently reported an interesting study upon 
*' The Disciplinary Values of Studies in the Opinion of 
Students." He had a large number of teachers and school 
officers rank various studies and other activities for the dis- 
ciplinary value which they obtained from them and, later, 
for the interest which they had in them. For several groups 
totaling nearly five hundred cases, he gets an unweighted 
average correlation of .66 with a P. E. of .03 between in- 
terest and discipline. He concludes : " On the whole it seems 
probable that the true resemblance is at least as likely to be 
above as to be below the resemblance computed from the 
reports. The discipline for enduring the disagreeable seems 

* 1923, pp. 79-90. 
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to be far outweighed by the discipline from working with 
an interested will along lines that fit one's abilities.'' ^ 

The importance of interest in education is continually 
growing greater. If we analyze the educational reforms of 
recent years, we find that their general purpose is to appeal 
to the children's interests more effectively and so better meet 
the children's needs. 

There is a general recognition of the educational signifi- 
cance of interests, but the experimental study of interests 
has scarcely been begun. 

^ Thorndike, 1924, p. 143. 



CHAPTER II 

The Justification of Vocational Guidance in the 

Junior High School 

Vocational guidance is an essential of a democratic system 
of education. The life of an individual is an organic whole. 
School life, if it is to function in such a whole, must be vitally 
connected with the period that precedes it and the one that 
follows it. We are here concerned with the latter relation- 
ship, the chief problem of which will not have been solved 
until the transfer from school life to after-school life has 
been facilitated and a sympathetic and intelligent interest in 
the latter period developed in the minds of the school pupils. 
Life cannot be an organic whole for those pupils who, on 
leaving our schools, are hurled, not guided, into an economic 
world of whose opportunities and demands they are ignorant. 
Under such conditions their choice of occupation is not based 
upon reliable information ; rather, it is a result of expediency 
or chance. Dewey * says, " A democratic criterion requires 
us to develop capacity to the point of competency to choose 
and make its own career/' The eiSciency of an educational 
system is judged by the extent of the carry-over of the 
changes which it has produced in the individual pupils and 
by the continued growth of the latter. Vocation is the next 
step after formal education. The extent and content of the 
education vary enormously among individuals, but the 
sequence always obtains. Therefore, one of the prime func- 
tions of education is its effectual, enlightening, vital con- 
nection with vocation. Vocational guidance is the connecting 
link. If we hold that education in a democracy should be 
based upon a sympathetic understanding of the interests, 
abilities, and needs of the individual and that these should 
be so dealt with that school life becomes a vital, coordinated 
part of the entire life, then we must grant that vocational 

* 1921, p. 139. 
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guidance is one of the most potent mediums available for 
making our schools democratic. 

The democratic aim of education is that there be equal op- 
portunity for all to develop and improve their original abili- 
ties and predispositions, however widely these may vary 
among themselves. An educational system that furnishes a 
preliminary training for certain vocations and fails to do so 
for others that are just as legitimate cannot be called demo- 
cratic. The schools of the past have been designed to provide 
vocational education for those who planned to pursue pro- 
fessional or semi-professional vocations. More recently voca- 
tional training for clerical workers has been undertaken. 
Democracy demands that this process of extension be made 
complete, that education be offered for every vocation that is 
considered lejgitimate and useful. The scope of the education 
offered is being broadened continually ; but, if maximal ser- 
vice is to be rendered, vocational education must be supple- 
mented by vocational guidance. 

Granting that vocational guidance is democratic, we have 
yet a very serious question to answer. At what stage of the 
pupil's education shall this guidance be given ? One caution 
must be observed : Guidance cannot be given in a day ; but 
must, to be of any value, be spread out over several years. 
Guidance without information is not democratic. Guidance 
must be given while the bulk of the children can yet be 
reached and not just before the great exodus takes place. 
This principle definitely determines that democratic voca- 
tional guidance must make its appearance earlier than the 
senior high school period. Thomdike has shown that out of 
every one hundred pupils finishing the sixth grade, seventy- 
nine complete the seventh, fifty-nine complete the eighth, 
and forty complete the ninth.* This determines our upper 
limit. The lower limit is not so easily established. For real 
vocational guidance, we may imore the first six grades, but 
certainly not for vocational information. True sjrmpathy must 
be based upon broad knowledge. The acquiring of occupa- 

* Thomdike, 1907, p. 15. 
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tional information may be made a genuinely cultural study. 
Somewhere in the grades the pupils must acquire a sympa- 
thetic and broad insight into the woric of the world. This is 
essential as a foundation whereon vocational guidance may 
build. Vocational guidance, to be democratic, must be given 
in the junior high school. The pupils are then in their early 
adolescent years. Most of them are near enough to entrance 
into the economic world to guarantee that genuine vocational 
activities will be satisfactorily motivated for them. The 
junior high school was established to meet the needs of these 
pupik. One of its fundamental aims is to provide exploratory 
fields for them in order that it may be ascertained whither 
their capacities, interests, and ambitions best fit them to go. 
Vocational guidance will complement this exploratory work. 
Vocational guidance is valuable not alone to those who must 
very soon become self-supporting, but also to those who will 
continue their studies. It will give them an opportunity to 
acquire a sympathetic understanding of the vocations of their 
fellows who must earn their living largely by the work of 
their hands. It will tend to clarify, in the minds of the 
latter, general vocational aims and so enable them to choose 
better their further preparatory education. Hence, vocational 
guidance is educationally economical ; it implies educational 
guidance. Children, vocationally informed and guided, will 
have more reliable and more definite interests and objectives. 
Also, by meeting the needs of many of the pupils who would 
otherwise leave school at this period, guidance can reduce the 
heavy pupil mortality among those who have finished the 
sixth grade. 

Thus vocational guidance in our schools is justified because 
it is thoroughly democratic in character. Correctly admin- 
istered, it will tend to break down objectionable class preju- 
dices. Further, it is seen to be most effective when it is pro- 
vided for the pupils during that critical period in their lives 
which they spend in the junior high school. 



CHAPTER III 
The Problem and the Methods 

" The changeable nature of interest is a major problem in 
vocational guidance," says McCall.* The present study was 
undertaken for the purpose of securing a solution for this 
problem. Specifically, its aim is to ascertain how permanent 
and how reliable are the vocational interests of pupils entering 
the junior high schools. The enduring interests of the child 
are the key to his success in life. But when does he acquire, 
or develop, these interests? If he already has them when he 
enters the junior high school, the basis for the work of that 
institution is presented. If he does not have them, it is the 
duty of that school to aid him in developing them. 

This study was undertaken in the autumn of 1922. The 
Grade 7B, or entering, pupils in eight of the ten junior 
high schools of Baltimore were examined. More than sixteen 
hundred children were included in the study. Two intelli- 
gence tests, the Illinois and the Mentimeter, were administered 
to provide an accurate rating in general ability. The average 
intelligence quotient used in this study is the unweighted 
average derived from the results of these two tests. The 
Toops I. E. R. Qerical Test Form i and the Stenquist 
Mechanical Test Form i were given in order to secure a 
measure of certain more or less specific capacities of the 
pupils. An interest questionnaire (See Appendix i)* was 
devised for the purpose of studying the vocational, recrea- 
tional, subject-matter, and work interests of the pupils.* 
The first questionnaire was filled out in December, 1922. 
Three follow-up questionnaires were given: One in May, 
1923, toward the end of the semester spent by most of the 
pupils in Grade 7A ; a second early in October, 1923, shortly 

* 1918, p. 185. 

' A copy of the final questionnaire is given there because it includes 
all the essential questions of the previous ones and one added feature. 

•The Work Interests Test was borrowed from the Work Interest 
Blank developed by Dr. Miner, of The Carnegie Institute of Tech- 
nology. 
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after the end of the summer vacation ; and a third in Decem- 
her, 1923, one year after the original. 

Vocational guidance cannot be successful through the 
following of interests alone. There are two conditioning 
factors: (i) The abilities of the pupils; and (2) the occupa- 
tional opportunities available.* The first of these is here 
taken into consideration by studying the pupils' interests by 
means of a classification based upon the average intelligence 
quotients of the pupils. We have the average intelligence 
quotients for the pupils of all but one school; in that only 
the Mentimeter Test was given. Sixteen hundred forty-four 
pupils filled out the original questionnaire. The intelligence 
quotients of fourteen hundred sixty-seven of these were 
available. These latter thus constituted the cases upon which 
the study is based. They were distributed into five groups 
as follows: i, the highest decile; 2, 3, the second and third 
highest deciles ; 4, 5, 6, 7, the middle four deciles ; 8, 9, the 
third and second lowest deciles; and 10, the lowest decile. 
These niunbers will be used to signify the several groups 
throughout the study. This distribution shows the following 
I. Q. limits for the several groups. (All I. Q. numbers are 
inclusive.) 

TABLE I 

Decile group I. Q. limits 

I 13^163 

2, 3 117-131 

4, 5. 6, 7 95-116 

8, 9 83-94 

10 52-82 

The average I. Q. for all of the children examined was 
approximately 105. 

The following table gives the number of cases in each 
group and the sex distribution for each. The ideal distribu- 
tions follow. 

*This second factor was not found susceptible to satisfactory 
treatment in this study. 
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TABLE 2 

ObUined distribtition Ideal distribution 

Decile group Boys Girls Tota^ Boys Girls Total 

I 85 60 145 71 76 147 

2, 3 157 135 292 142 152 2Q4 

4. S» 6, 7 272 320 592 282 303 505 

8, 9 127 164 291 142 152 294 

10 67 80 147 71 76 147 

708 759 1467 708 759 1467 

This indicates that the obtained total distribution approxi- 
mates the ideal one. However, the sex distribution is not 
normal. Combining the two upper groups and calling them 
the A (above-average) group, the two lower groups and 
calling them the B (below-average) group, and designating 
the middle group as M, we get the following table: 

TABLE 3 

Numerical distribution 

f ■ * \ 

Boys Girls Percentage of 

t ^ % r— — •* \ displacement 

Actual Ideal Actual Ideal / ^ x 

Groups number number number number Boys Girls 

A 242 213 195 228 +13 —14 

M 272 282 320 303 — 4 +0 

B 194 213 244 228 — 9 -|- 7 

Totals . 708 708 759 759 

These figures show that for this group the boys are 
markedly superior to the girls in general intelligence as 
measured by the two tests used. 

The next problem to present itself for solution was the 
classification of occupations. No classification reported in 
the past proved entirely satisfactory. The classification had 
to be comprehensive, yet not unwieldy. Eventually a fifteen- 
fold classification was worked out. The following divisions 
were decided upon: Agriculture, Manufacturing, Mechanical 
Industries, Transportation, Trade, Public Service, Engineers, 
Physicians, Lawyers and Judges, Teachers, Entertainers and 
Artists, Other Professional Services, Domestic and Personal 
Services, Clerical Workers, and No Choice. Several explana- 
tory notes must be given. Manufacturing here has reference 



20 THE PROBLEM AND THE METHODS 

to Operatives. Trade indicates business activities, not the work 
of mechanics. The professions are divided in six groups be- 
cause the amount and kind of training required for the 
several professions varies greatly. Where there was any 
doubt about the classification of any particular occupation, 
the Government Census classification was consulted and 
followed. 

The data are tabulated in double-entry tables. Each table 
shows the relationship between the results of two sets of 
questionnaires. The records for the boys are kept separate 
from those for the girls. The rows indicate the choices for 
one period and the columns, those for the other. Hence, the 
entry for any pupil who makes the same choice on both 
occasions will appear in the diagonal of boxes extending from 
the upper left-hand comer of the table to the lower right-hand 
comer. This is spoken of as the " diagonal of permanency." 
The number of cases appearing in this diagonal divided by 
the total number entered in the table gives the percentage of 
permanency. In all the permanency tables, the number in 
the upper left hand comer of a box represents the boys; 
the number in the lower right-hand comer represents the girls. 



CHAPTER IV 

The Original Distribution of Vocational Choices 

The following table gives the vocational distribution, in 
percentages, of the entire group of boys and girls who filled 
out the first questionnaire. 

TABLE 4 

Occupational group ^97* Girls 

% % 

Agrriculture .6 .i 

Manufacturing i.8 2.6 

Mechanical industries 20.5 i.i 

Transportation 1.6 1.0 

Trade ii.i 2.3 

Public service i.i o 

Engineers 21.5 o 

Physicians 8.1 .7 

Lawyers and judges 6.5 1.5 

Teachers 1.3 ^.S 

Entertainers and artists 3.2 4.3 

Other professions 12.6 6.7 

Domestic and personal o .^ 

Qerical 84 49-9 

No choice 1.7 i>9 

Total 100.0 100.0 

To aid us in observing the tendencies as they vary from 
decile to decile, a more compact grouping will be serviceable. 
The following combinations and changes are effected : 

(i) The six classes of professions are combined. 

(2) Mechanical Industries, Manufacturing, and Agricul- 
ture are combined tmder the first mentioned name. 

(3) General Service includes: Transportation, Public Ser- 
vice, and Domestic and Personal Service. 

TABLE 5 

BOYS 

Highevt ad and Middle 8th and Low- AU 
decile jd four 9th est deciles 
% % % % % % 

L Professions 59 64 55 43-5 3i 53 

2. Trade n 95 ^o 10.5 19 11 

3. Mechanical industries ig i7-5 22 29 39 23 

4. Qerical work 8 4 10 12 8 8 

5. General service 6 2.5 i 4 3 3 

6. No choice i 2.5 2 i o a 

21 
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Highest 2d and Middle 8th and Low- AU 
decile 3d four 9th ett deciles 

%%%%%% 

1. Professions 68 56 42 29 17 41 

2. Trade 2 2 I 2 7.5 2 

3. Mechanical industries 3.5 4 3 6.5 2.5 4 

4. Qerical work 21 37 SO 60 70.5 SO 

5. General service 2 o i i 2.5 i 

6. No choice 3.5 i 3 i-S o 2 

The most striking fact revealed by Table 4 is the marked 
difference in the spread of choices between the sexes. Of the 
fourteen groups, the boys have more than Sfl in seven of 
them. The girls exceed 5)< in only three groups. The two 
most favored groups among the girls draw 75j< of the 
choices. We must include the six most favored groups among 
the boys to reach this percentage. This seems to indicate that 
a girl's vocational outlook is much more restricted than a 
boy's. 

The decile table for boys shows that the percentage of 
professional choices is pretty constant among the two upper 
and the large middle groups. Then this percentage falls off 
abruptly. Trade remains constant throughout, save in the 
lowest decile where a sharp rise is noted. The choice of 
mechanical industries shows a constant tendency to vary 
inversely with intelligence. Judging by these figures, we may 
say that the lower the intelligence, the greater is the likelihood 
that a boy will be interested in becoming a mechanic. Qerical 
choices are fairly constant throughout, as are those for 
General Service. 

Among the girls Trade, General Service, and Mechanical 
Industries are constant and unimportant. Professional pref- 
erences show a marked and steady decrease with diminished 
intelligence. Qerical preferences show an even more marked 
rise with diminished intelligence. These statements suggest 
that girls' preferences for teaching and clerical work have 
a direct relationship to intelligence. The following table gives 
the facts: 
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TABLE 6 

Percentage of Percentage of Percentage of 
girls choosing girls choosing girls choosing 
teaching clerical work something else 

1. Highest decile . . 43 2i 36 

2. 2d and 3d 37 37 26 

3. Middle four ... 30 50 20 

4. 8th and 9th 19 60 21 

5. Lowest 10 70 20 

Total group . . 27 50 23 

The evidence is conclusive and striking. The girls of 
higher intelligence are far more likely to select teaching 
than the others. Also, those of higher intelligence are the 
more likely to choose some vocation other than one of these 
two. There seems to be a crying need for vocational guidance 
here in regard to these clerical choices. Not only must many 
aspirants be disappointed in their hopes because the supply 
exceeds the demand, but many are not qualified to succeed 
were there unlimited opportimities. Vocational guidance 
must meet thdr needs early if it is to assure any real 
economic success. 



CHAPTER V 

The Permanency from Grade 7B to Grade 7A 

The first follow-up questionnaire was given in May, 1923, 
one semester later than the original one. Of the original 
fourteen hundred sixty-seven pupils, twelve hundred fifty- 
eight filled out this questionnaire. The following table shows 
how the eliminaticms were distributed. 

TABLE 7 

EUMINATIONS FBOM DECEMBER, 1^22, TO MaY, 1^23 

Ntunber Percentage 

Decile / * \ / * % 

group Boys GirU Total Boys Girls Total 

I II 14 25 13 23 17 

2, 3 ID 20 30 6 15 10 

4, S. 6, 7 15 12 27 64s 

8,9 45 40 8s 35 24 ^ 

ID 21 21 42 31 26 29 

Total 102 107 209 14 14 14 

The follow-up technique used with later questionnaires 
was not fully developed for this one ; therefore, it is probable 
that the eliminations are unduly large. This point will be 
discussed later at greater length. 

Table 8 gives in detail the relationship of the original 
choices to those expressed by the pupils in May.* In Table 9 
the percentages of permanency for the several decile groups 
are presented. 

* Tables giving the relationship for each decile group scparatdv 
are included in the original copy of this study, which is on nle with 
the librarian of The Johns Hopkins University. 
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TABLES 
VocATiOKAL Choices of Entibs Gboup nou Dbcbubei, 1933, to May, i{ 

CHOICES— MAY, i«33 
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TABLE 9 
Vocational Interests from December, 1922, to May, igaj 

PERCENTAGES OF PERMANENCY 

Decile groups Boys GirTs Total 

I 58 65 60 

2, 3 67 73 69 

4. S, 6, 7 59 74 67 

8» 9 45 75 63 

10 54 64 60 

Total — 58.2 72.7 65.7 

Intelligence does not seem to have any clear-cut relation- 
ship to permanence. The percentages are fairly constant 
throughout the five groups. However, the girls consistently 
show a much higher percentage of permanency than do the 
boys. We have already shown that the girls' choices are re- 
stricted to far fewer groups than are the boys'. This fact 
seems sufficiently potent to account for the difference. A 
greater number of possible choices means finer gradations. 
Finer gradations permit easier transfer from one group 
to another. Easier transfer means diminished permanence. 

The total percentage of 65.7^ seems rather high. How- 
ever, no previous studies have given standards* whereby 
we may make comparisons. The results obtained from the 
three other kinds of interests here studied may be used 
for this purpose. However, in all three of them, the choice 
was more or less controlled, while in the vocational interests, 
it was absolutely uncontrolled. Comparable results are pre- 
sented in the tables that follow : 

* Since this was written, McCracken and Lamb have published a 
book, entitled " Occupational Information in the Elementary School," 
in which certain somewhat similar results are reported. For 53 
seventh grade junior high school boys and 100 girls, they received 
a permanency percentage of 56.6% for the boys and 46% for the girls 
for a period lasting slightly more than a year during which three 
choices were made. 
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TABLE ID 

Favorite Studies (13 Groups*) 
percentages of permanency 

Decile groups Boys Girls Total 

I 42 42 42 

2, 3 35 36 35 

4, 5, 6, 7 35 41 38 

8, 9 44 34 38 

10 25 35 31 

Total 36 37 37 

Here we find that the choices of the boys and girls arc 
practically of equal .permanence. It is interesting to note 
that the range of possible choices is equally g^eat for both 
girls and boys in regard to school subjects. 

TABLE II 

Favorite Kinds of Entertainment (12 Groups*) 
percentages of permanency 

Decile groups Boys Girls Total 

I 42 49 44 

2, 3 36 40 38 

4, 5, 6. 7 44 33 38 

8, 9 38 36 37 

10 54 34 43 

Total 41 36 39 

It will be noted in this table that, where girls and boys 

have an equally unrestricted choice, the boys' interests are 

markedly more permanent than the girls'. So we cannot say 

that girls are naturally less likely to change their interests 

than boys. 

TABLE 12 

Favorfte Kinds of Activity (23 Groups *) 
percentages of permanency 

Decile groups Boys Girls Total 

I 34 57 44 

2, 3 30 51 39 

4, 5» 6, 7 30 40 36 

8, 9 23 31 28 

10 30 24 27 

Total 29 40 34 

* Sec Appendix i. 
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Here once more we are dealing with vocational choices. 
The greater restriction of the girls again plays a part* In 
no single g^oup do we find more than 15^ of the boys' 
choices ; in one group there are over 30j< of the girls'.* Fif- 
teen different groups have been selected by ten or more boys ; 
in only eleven groups are ten or more girls represented.* 
Hence, for the reason previously expressed, we should 
expect the prls' permanency percentage to be higher than 
the boys' and we are not disappointed as the table reveals 
a difference in their favor of iij<. The fact that none of 
these controlled interests shows a percentage of permanency 
two-thirds as high as that of the uncontrolled vocational 
interests permits us to consider the latter as quite significant.' 

The gross distributi(m of vocational choices made in May 
corre^)onds very closely with that of the previous December. 
The two distributions are 91.9^ identical Ranking the fifteen 
groups and applying the Spearman Rank-Difference formula, 
we get f>=.956, which is equivalent to a Pearson r of .96. 
These figures indicate that there is some equalizing principle 
at work. While one-third of the individual pupils change 
their choices, the entire distribution alters less than lojt. 

^The table showing this distribution is not included. 
"Sec Chapter XIII, pp. 54-55. 



CHAPTER VI 

The Effect of a Summer Vacation on Pupils' 

Vocational Interests 

Determination of the percentage of permanency of chil- 
dren's vocational interests is one problem ; determination of 
the causes for their changes in interests is another. When 
we come to analyze the latter problem into the factors in- 
volvedy the most valuable classification is that based upon 
the sources of these causes. Are these sources within or 
without the school ? The former will predominate during the 
school year, the latter during the summer vacation. For the 
purpose of obtaining light upon this question, the question- 
naire was given to the pupils again early in October, 1923, 
shortly after their summer vacation. This questionnaire 
represented the bulk of those examined as beginning Grade 
8B pupils, but some had been retarded and were scattered 
through 7A and 7B classes. However, all are treated in this 
study. 

The details are given in Table 14.* The following table 
presents a summary of them. 

TABLE 13 

Permanency of Vocational Interests from May, igaj, to 

October, 1923 

percentages of permanency 

Decile groups Boys Girls Totah 

I 84 87 85 

2,3 74 83 78 

4, 5, 6, 7 71 8i 77 

8, 9 66 78 73 

10 72 87 80 

Total 73.2 82.0 TJ^ 



The period from December to May and that from May 
to October are of very similar length and, to that extent, com- 

* Tables giving the relationship for each decile group separately 
are included in the original copy of this stud^, whidi is on file with 
the librarian of The Johns Hopkins University. 
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TABLE M 
VocATioNAi. Choices of Emthk Group psom May, 1933, i 
CHOICES— OCTOBER, ifij 
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parable. The permanency for the second period shows a gain 
of more than 12^ over that for the first. The boys gain 
iSJl in permanence, while the girls are gaining 9.3;^. These 
figures show that very slight changes take place in pupils' 
vocational interests during the summer vacation. These inter- 
ests are either not considered, or the activities and environ- 
ment of the pupils tend to fix, rather than to change, them. 
There seems to be revealed a slight tendency indicating that 
the more intelligent a pupil is, the more likely he is to stick to 
his vocational choice over the summer. 

The inadequate follow-up in May and the ordinary drop- 
ping out of pupils between the seventh and eighth grades 
combined to reduce the figures for this distribution to one 
thousand twenty-seven pupils. 



CHAPTER VII 

The Combined Effect of a Period Covering Half a 
Year's School Work and a Summer Vacation 

From this third questionnaire we may also derive the per- 
centages of permanency for the period extending from 
December, 1922, to October, 1923. They will rq)resent the 
combined effects upon the pupils' interests of one semester 
in school and a summer vacation. The percentage of perma- 
nency for the entire group for this period of ten months is 
66,i^f a slight gain over that for the first period of five 
months. However, the most striking point revealed by this 
comparison is the high constancy of the percentage of per- 
manency. Analyzing the comparative distributions for sex 
differences in permanency, we find the prls 1,3^ lower than 
before and the boys 1.95^ higher, the difference between the 
two being thus reduced from 13.5^ to ii.2j<. The detailed 
distribution is given in Table 16.* The results are stunmarized 

in Table 15. 

TABLE IS 
Percentages of Permanency from December, 1932,10 October, 1923 

Decile groups Boys Girls Totals 

I 63 73 67 

2, 3 67 70 68 

4, S. 6. 7 56 76 65 

8, 9 61 70 66 

10 54 68 62 

Totals . . . 60.1 714 66.1 

The percentages shown in Table 15 indicate that there is 
practically no relationship between intelligence and the per- 
manence of vocational interests. 

The two total distributions here imder consideration are 
89.5}^ identical. If the fifteen vocational groups for each are 
ranked, a Spearman p=.9S, equivalent to a Pearson r=.9S4. 
is secured. These figures show that the distribution of choices 
expressed in the third questionnaire is not quite as closely 
related to the original distribution as is that of those expressed 
in the second questionnaire. 

^Tables giving the relationship for each decile group separately 
are included in the original copy of this study, whidi is on file with 
the librarian of The Johns Hopkins University. 
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TABLE i6 

Vocational Cboices or Ehtibe Gsoup nan DKCKuna, 1932, 10 Octcwbs, i{ 

CHOICES— OCTOBER, ifl« 
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CHAPTER VIII 

The Effect of One Year on the Original Choices 

The third follow-up questionnaire was administered in 
December, 1923, one year after the original questionnaire. 
The percentage of permanency for the entire group is 66.7^, 
being slightly higher than that secured for either of the 
two shorter periods, (i) December to May and (2) Decem- 
ber to October. The detailed distribution is presented in 
Table 19.* The results are stunmarized in Table 17. 

TABLE 17 
Pekcentages of Pebmanency p(» the Entise Yeas 

Decile groups Boys Girls Totals 

I 65 63 €4 

2, 3 64 69 67 

4.5.6,7 60 73 68 

8, 9 60 y(i 71 

10 SS 54 54 

Totals ... 61.6 70.8 66.7 

If we exclude the lowest decile group, there seems to be 
a slight n^[ative relationship here obtaining between intelli- 
gence and the d^ree of permanence of interest. 

There seems to be a marked tendency for the difference in 
permanence between the girls' interests and the boys' interests 
to be gradually diminished. The figures for the three follow- 
ups are presented in Table 18. 

TABLE 18 
Sex Differences in Permanence 

Boys Girls Difference 

% % % 

Dec, '22, to May, '23 58-2 72.7 14,5 

Dec, '22, to Oct., '23 60.1 714 11^ 

Dec, *22, to Dec, '23 61.6 70.8 9.2 

The fact that two-thirds of the children have the same 
interest after the lapse of a year indicates that these interests 

^Tables giving the relationship for each decile group soparatelv 
are included in the original copy of this study, whidi is on file with 
the librarian of The Johns Hopkins University. 
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TABLE 19 
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are of value and that they must be taken into consideration 
in vocational guidance. The reliability of these data will be 
discussed in a later chapter. 

The original and the fourth distributions are 90.6^ iden- 
tical. This shows that the compensatory factor previously 
noticed is still at work. If the groups of both distributions 
are ranked and the Spearman Rank-Difference formula 
applied, we get a ^=.987, which is equivalent to a Pearson 
r of .988. The ranking in favor of the fifteen groups is prac- 
tically constant at all four testing periods. 



CHAPTER IX 

The Interests and the Intelugence op the 

Eliminated Pupils 

During the year which this study covers, three hundred 
sixty-five pupils, or one-fourth of the original group, were 
eliminated. One of the chief purposes of the junior high 
school is to reduce the early pupil exodus as greatly as pos- 
sible. Therefore an explanation of these losses is most perti- 
nent. Can it be that the junior high school is not appealing 
to the interests of these children who leave so early? An 
analysis of the vocational interests that they expressed on 
the first questionnaire may help us to answer this question. 
Table 20 shows the distribution of their original choices 
among the fifteen vocation groups. 

TABLE 20 
Vocational Interests of the Euminated Pupils 

Vocational Totat 

Group Boys Girls group 

Agriculture o o 

Manufacturing o o 

Mechanical industries . . 75 75 

Transportation 3 4 7 

Trade 37 9 46 

Public service 3 3 

Engineers 40 o 40 

Physicians 6 o 6 

Lawyers 8 i 9 

Teachers o 25 25 

Entertainers and artists. 5 6 11 

Other professions 14 10 24 

Domestic and personal., oil 

Gerical 20 94 114 

No choice 2 2 4 

Totals 213 152 36s 

This g^oss distribution shows that the choices are by no 
means evenly divided among the several groups. Its meaning 
may be more easily grasped if we know the percentage of 
those originally choosing each specific group that has been 
eliminated. The following tables will give this information 
for the boys and girls separately. 
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TABLE ai 
EuMiNATioN Among the Boys 
(Showing percentage of each group that was eliminated) 

% 

Transportation (6)* 50 

Mechanical industries ..(166) 45 

Trade C90) 41 

Gerical work (54) 37 

No choice ?6) 33 

Public service (9) 33 

Engineers (155) 26 30% elimination 

Entertainers and artists. (21) 2a for entire group. 

Lawyers (50) 10 

Other professions (88) 16 

Physicians (501 12 

Teachers (3) 

Agriculture (7) 

Manufacturing (3) o 

*The numbers in the parentheses show how many boys' interests 
originally fell in each group. 

This table seems to tell a very straightforward story. 
We may neglect the six groups that failed to attract as many 
as ten boys. They are statistically worthless. Then we see 
that all those groups wherein the eliminations arc below 
the percentage for the entire group are professional while 
all those wherein they are above the average are non-profes- 
sional. Less than 20^ of the boys with professional ambitions 
leave school during the year; more than 44)1 of those with 
non-professional aims do so. A lofty interest holds the Pupil 
in the school. Those who are interested in vocations, entrance 
to which is dependent upon long and exacting educational 
preparation, tend to stay in school. Those who are interested 
in the less exacting vocations tend to drop out Do these 
latter pupils feel that they are sufficiently trained to succeed 
in their chosen calling? Or do they feel that the school has 
nothing further of value to offer them? Four-fifths of this 
group are interested in becoming mechanics or ttadesmen. 
The duty of the junior high toward them is as yet largely an 
unsolved problem. 

We must now look at the other side of the picture and 
what part interest plays in the eliminations of the girls. 
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TABLE 22 

EuMiNATiON Among the Gisls 
(Showing percentage of each group that was eliminated) 

Trade (16)* 56I 

Transportation (8) 50 

Gerical work (3801 25 

Other professions (45) 22 

Domestic and personal. (5) 20 

No choice (11) 18 

Teachers (220) 11 

Lawyers ^10) 10 

Entertainers and artists. (60) 10 

Physicians (4) 



^20% elimination 
for entire group. 



^The numbers in the parentheses show how many girls' interests 
originally fell in each group. 

The interpretation here is not quite so simple. The very 
small groups must be ignored as usual. It is necessary to 
remember that three-fourths of the g^rls are interested in two 
of the groups — clerical work and teaching. Of these the girl 
expressing a choice for clerical work is 25^ more likely to 
drop out than the average girl. The one who wishes to teach 
is little more than half as likely to do so as the average girl. 
The same tendency seems here revealed as was shown in the 
cases of the boys. I2jf of the girls with professional ambitions 
are eliminated as against 26^ of those with non-professional 
interests. Interest is undoubtedly a significant factor in pupil 
elimination. 

There are at least two other possible causal factors involved 
in elimination that will repay study. They are economic 
pressure and ability to do the work. With the data at hand 
we can get at the former only indirectly. However, the intelli- 
gence ratings give us a definite basis for investigating the 
latter. The eliminations for two periods will be studied: (i). 
from December, 1922, to October, 1923; and (2) from 
December, 1922, to December, 1923. For these two periods 
the follow-up technique was sufficiently developed to provide 
a reliable measure of the actual elimination. One hundred 
thirty-eight cases, which had not been reached in May, were 
recovered in October. During the period f rcwn December to 
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October there were three hundred two withdrawals. This 
represents 2i}< of the original group. They are distributed in 
respect to intelligence and sex in the following table : 

TABLE :?3 
EuMiNATioNS During Decbmbeb to October Period 

Expressed in numbers Expressed in percentmges 
Decile / * \ / ^ \ 

groups Boys Girls Total Boys Girls ToUl 

I 314 423 

2, 3 23 22 44 14 16 15 

4. 5, 6, 7 37 20 57 14 6 10 

8,9 61 55 116 48 34 40 

10 39 42 8i 58 53 55 

Totals ... 162 140 302 23 18 21 

Economic pressure would naturally inflict a heavier toll 
upon the boys than upon the girls. This expectation is here 
corroborated ; a boy's chance of sta3ring in school during this 
period is 94^ as good as a girl's. This seems to indicate that 
economic pressure is not a deciding factor. A glance at the 
table suggests that intelligence may afford the clue. For con- 
venience we may call .the first, second, and third deciles the 
A (above-average) group; the middle four deciles the M 
(middle) group; the eighth, ninth, and tenth deciles the B 
(below-average) group. The percentage of elimination in 
each g^oup follows: 

B07S Girls 

Group % % 

A 10 II 

M 14 6 

B 51 40 

Here the story in clear. The A and the M groups are 
very similar, but the B group has nothing in common with 
them. A boy with " B " intelligence is five times as likely to 
be eliminated as a boy of " A " intelligence. For the girls the 
corresponding figures are approximately four to one. Also, 
a girl with " B " intelligence is four times as likely to 
be eliminated as an " A " boy. More than 6$^ of the with- 
drawals occiu- in the B g^up, or lowest 30j< of the pupils ; 
i, e., 2i7J^ of the number which this group would be expected 
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to furnish if it were entirely a matter of chance and intelli- 
gence were a negligible factor. 

Before drawing further conclusions, we should examine 
the results for the entire year. 

TABLE 24 
EuMiNATioNs During One- Yeas Period 

Expressed in numbers Expressed in percentages 

Decile r -*- \ / * \ 

groups Boys Girls ToUl Boys Girls Total 

I 606 704 

2, 3 35 18 53 22 13 18 

4, 5, 6, 7 SI 36 87 10 II IS 

8, 9 74 57 131 58 35 45 

10 47 41 88 70 51 60 

Totals 213 152 365 30 20 25 

During the entire year one- fourth of the pupils studied 
are eliminated. Three-fifths of these are boys. In other words, 
a boy's chance of staying in school is seven-eighths as good 
as a girl's. To study the influence of intelligence, we may 
again use the threefold classification suggested above. 

Percentages of Eumination 

Boys Girls 

Group % % 

A 17 9 

M 19 II 

B 62 40 

In the main this table tells the same story as the previous 
one. The '* B " group furnishes 60^ of the eliminated pupils^ 
or just twice as many, as would be expected if intelligence 
were a negligible factor. Less than one-sixth of the elimina- 
tions are in the " A " group. A boy of superior intelligence 
is not half as likely to withdraw as a girl of inferior capacity. 
Therefore, we are justified in rel^^ting economic pressure 
to a relatively unimportant place in studying eliminations 
and in placing maximum emphasis upon the ascertainment of 
intelligence. 

Only one more fact remains to be considered. By October 
the percentage of boys eliminated was little more than one- 
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fomth greater than that of girls. By December this diflFerence 
had increased until it was half again.as great. What is the 
reason for this? During Grade 7B all the children take an 
undifferentiated course. Several elective courses are offered 
during Grade 7A. During this year, the percentages rq>rescn- 
tative of these two grades (7B and 7A) have been very 
similar. In Grade 8B, the pupils are permitted to specialize 
more markedly. It was during this period of marked differen- 
tation that the school's holding power decreased so greatly in 
the case of the boys in comparison with that of the giris. 
It may be that there are not enough courses offered to appeal 
to the interests of the boys. Or, in light of the fact that four- 
fifths of these boys are interested in becoming mechanics or 
tradesmen, it may be that they fed that they have sufficient 
school training for their chosen vocations. No data are at 
hand to establish a satisfactory explanation. However, we 
may conclude that the vocational interests and the intelligence 
of pupils are exceedingly significant and potent factors in 
determining how long the pupils will remain in school. 



CHAPTER X 
Are the Interests Expressed of Practical Value? 

If we can determine whether or not the interests expressed 
function in every-day life we shall have a valid measure of 
their vitality. Inasmuch as the pupils are not yet engaged in 
their vocations, our field of investigation must be limited 
to school activities. Do these interests guide the pupils in 
their making of decisions? The most important decision that 
a pupil must make during his junior high school career is to 
choose which course of three — academic, commercial^ and 
industrial — ^he will pursue. This choice is made at the 
beginning of the second half-year ; i. e., at the beginning of 
Grade 7 A. If a pupil's selection proves obviously incorrect, 
he is permitted to transfer to another course. However, the 
percentage of transfers is really very low. In order that the 
vitality of their interests might be studied, the children were 
asked to indicate on the last questionnaire what course they 
were pursuing. Only six pupils out of the one thousand one 
hundred two failed to do so. What relation does their selec- 
tion of courses bear to their avowed vocational interests? 
In order to answer this question, the data were tabulated 
in double-entry tables. What course must a pupil with a 
given interest take in order that he may best prepare himself 
for his desired work? That this latter question might be 
satisfactorily answered it was necessary to study the several 
vocational groups and work out a classification of correspon- 
dence. This classification follows : 

The academic course is the proper one for those interested 
in the following vocational groups: Trade, public service, 
physicians, lawyers, teaching, entertainers and artists, other 
professional services, transportation, domestic and personal 
services, engineering and no choice. 

The commercial course is the proper one for those desiring 
to enter the following vocation : Clerical services. 
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The industrial course is the proper one for those interested 
in entering the following vocations: Agriculture, manufac- 
turing, mechanical industries, and engineering. 

Both the academic and industrial courses were considered 
a satisfactory preparation for engineering because pufnls who 
have c(Hnpleted either course are eligiUe to enter the Poly- 
technic Institute, the technical high school of Baltimore. 
However, the investigation showed that nearly all the boys 
who desired to be engineers were taking the industrial course. 

Table 26 shows the distributions of these data tabulated 
for the entirp group.* The percentage of agreement between 
vocational interest and course selected is very high, 92.2;^. 
Even this figure is probably too low. The rigidity of the 
classification caused some few choices to be classified as 
illogical which were probably not really so. For example, 
several boys who wished to become architects (therefore 
being classified in the "Other Professional Group") are 
taking the industrial course. Inasmuch as this course gives 
them mechanical drawing, they are probably right in their 
choice, yet our classification records them as pupils making 
illogical selections. We may say that pupils' vocational in- 
terests function in nearly every case in their making of the 
most significant decision required of them during their 
three-year course. 

The percentages of agreement do not vary greatly from 

decile to decile. 

TABLE 2S 

Vocational Intebest and Selected Coukse 
percentage of identity 

BoTt Girls Total 

Decile groups % % % 

I 924 91.6 92.0 

2,3 91^ 930 924 

4, 5, 6, 7 91.8 93.0 924 

8, 9 90.6 92,5 91.9 

10 90.0 89.7 89.8 

Total 91.7 92.7 92.2 

* Tables giving the distribution for each decile group sepuatelv 
are included in the original copy of this study, whidi is on me with 
the librarian of The Johns Hopkins University. 
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There is no appreciable difference between the percent- 
ages of the boys and those of the girls. Therefore, we may 
conclude that there is an unusually high relationship extant 
between vocational interest and school course selected and 
that it is conditioned by neither intelligence nor sex. 
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Relationship between Interest Expressed and C6usse Selected 
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CHAPTER XI 

The Relation of Interest to Ability, an Intensive 
Study of the Pupils Making Clerical Choices 

Do pupib who adhere to a certain vocational choice tend 
to have capacities that will give them success in that vocation ? 
This is a very large question and must receive extensive 
investigation before it is solved. An answer to this question 
is here sought in just one vocational group and the criterion 
of success is necessarily of uncertain value. Of the fourteen 
vocational groups, the clerical one was found to be con- 
sistently much larger than any other. Not only this, but the 
I. E. R. Qerical test, supposedly capable of predicting 
clerical capacity to an appreciable extent, had been given 
to the pupils. These two reasons brought about the selection 
of the clerical group for special duty. There were two hun- 
dred sixty-three pupils — ^two hundred thirty-seven girk and 
twenty-six boys — who made clerical choices in the banning 
and still held to them in October, 1923. The pupils in three 
large schools were finally selected for special study. When 
the necessary deductions, due to withdrawals, incomplete 
records, etc., were made, the niunber of pupils in these 
three schools who persistently made clerical choices was 
found to be one hundred thirty-five— one hundred twenty- 
four girls and eleven boys. This niunber is large enough 
to be representative of the whole clerical group. 

Although differentiation in studies commences half a year 
earlier, these pupils get their first real commercial work at 
the beginning of Grade 8B. Their class marks* in their 
commercial subjects — ^typewriting, bookkeeping, and com- 
mercial arithmetic — are here considered as a measure of 
their probable success in commercial work. The scores made 
in the I. E. R. Clerical test are used in order that its pre- 
dictive value may be studied. Their average intelligence 
quotients (the average, for each pupil, of the I. Q. received 

* The passing mark in these schools is " 60." 
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in the Illinois test and that in the Mentimeter test) and the 
mental age, expressed in months, were also used. Each of a 
pupil's three commercial teachers assigned him an effort 
mark upon a scale ranging from one to ten. The subject- 
matter marks and the effort marks were secured for the 
first and second quarters of the eighth grade separately. 

The one hundred thirty-five pupils had an average I. E. R. 
Qerical test score of 47.5. This may be compared with the 
score of a larger unselected group, of which these pupils 
were a part, previously calculated in connection with a pre- 
liminary study; they, a group of six hundred thirty-five 
pupils, had an average score of 37.5. The average intelligence 
quotient of the one hundred thirty-five pupils was 99.3 ; that 
of the entire group (of which these six hundred thirty-five 
constitute a representative sample) was approximately 105. 
That is, while these pupils whose interest in a clerical vocation 
had remained permanent averaged somewhat below the large, 
unselected group in general intelligence, they were markedly 
superior to them in clerical ability as measured by the I. E. R. 
Clerical test. 

Toops has no adequate norms for Grade 7B pupils with 
which these results may be compared. However, for eight 
hundred fifty-one Grade 8B boys, he found an average of 43.5 
and for one thousand forty-six Grade 8B girls, an average 
of 42.5. Therefore, it seems that our specially interested 
pupils are definitely superior to unselected pupils a year 
further on in school than they. Interest is, undoubtedly, a 
potent factor here. 

The three effort marks for each quarter were averaged in 
order to increase the reliability. A corresponding average 
subject-matter mark for each quarter was found by averag- 
ing the marks made in each of the three conunercial subjects. 
For the first quarter the following figures show the averages 
of the group: 

Arithmetic mean S. D. 

Typewriting 70.0 10.3 

Bookkeeping 75.5 10.5 

Commercial arithmetic 72.3 16.6 

Average mark 724 9.4 
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The following figures are for the second quarter: 

Arithmetic mean S. D. 

Typewriting 743 lao 

tiooldceeping 75.7 ii.i 

Commercial arithmetic 72.1 13^ 

Average mark 73.7 7 A 

These figures show that the distributions for the two 
quarters are very similar, with the averages becoming slightly 
higher and the variabilities becoming more markedly less. 

When results for the second quarter's work came in, it 
was found that nine more pupils — eight girls and one boy — 
had withdrawn from the school, leaving a total of one hun- 
dred twenty-six pupils for study. 

The following table gives the corrdations worked for 
both quarters : 

TABLE 27 

For first For second 
CorreUtioa quarter quarter 

between (135 cases) (is6 cases) 

1. I. K R. clerical and average mark 14 .3^ 

2. I. K R. clerical and typewriting — .10 .11 

3. I. K R. clerical and bookkeeping 12 .34 

4. L K R. clerical and commercial arithmetic, ai .29 
S Average mark and average I. Q .33 .29 

6. Average mark and mental age .29 .24 

7. I. £. R. clerical and average I. Q .35 -40 

8. I. E. R. clerical and mentsd age .36 .33 

9. Effort and average mark .62 .68 

10. Effort and average I. Q 30 .23 

11. Effort and mental age j2S .19 

12. Effort and I. K R. clerical 33 .36 

The most striking correlations are those between the 
clerical test and the school subjects. With average subject 
marie the r is nearly tripled from the first to the second term, 
rising from .14 to .38. It is interesting to contrast the corre- 
lation of the clerical test with arithmetic with those obtained 
with the two other subjects. For the first quarter, arith- 
metic is the only one of the three that is of any sig^ficance. 
It should be noted that the pupils have been working arith- 
metic for years, while typing and bookkeeping are entirely 
new to them. Such being the case, we should expect a certain 
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time to be required for the pupils " to find themselves." And 
until they should have found themselves, no prognostic test 
would be likely to correlate closely with their accomplishment. 
The remarkable increases noted in the second quarter seem 
to justify this explanation. The r with typing gained twenty- 
one points, rising from a minus quantity; that with book- 
keeping gained twenty-two points, and that with arithmetic, 
eight points. We may at least tentatively conclude that the 
Toops test tends to show a positive relationship with accom- 
plishment in clerical studies and that this relationship grows 
closer as time goes on. Further study will be carried on to 
determine the extent to which this tendency continues. 

Effort shows a fair correlation with predicted ability. 
Effort correlates quite highly (.62 and .68) with the average 
school mark. In order to evaluate the effort marks given 
by the teachers, those of the first quarter were correlated with 
those of the second. A remarkably high correlation of .79 
was secured. This assures us that our attempt to measure 
effort here is, to say the least, highly consistent. 



CHAPTER XII 

Variations Among the Several Vocational Groups 

Is the permanence of a pupil's interest in any way depen- 
dent upon the particular vocational group in which that 
interest falls? We can secure an answer to this question by 
stud3ring the records of the pupils whose choices originally 
fell in each group and by determining what percentage of 
each group adhered to the original choices. The necessary 
information is given in Table 28. 

TABLE 26 
Group Percentages of Permanency 

Boyt Girb Total group 

^ f ^ \ t * V f ^ \ 



s^ 



•a-a ®H Sfo' 'sn ®a Sf^^ 'sn a 

U «« ^B §g -So h §e -sq g| |g 

8a O.S ot gS. O.S oSL b& 0.2 oK iiL 

Agriculture 7 5 71 7 5 71 

Manufacturing 3 i 33 3 i 33 

Mechanical industries ... 91 49 54 91 49 54 

Transportation 3 133 4 2 50 7 343 

Trade 53 32 60 7 o o 60 3^53 

Public service 6 5 83 6 5 83 

Engineers 115 75 65 115 75 65 

Physicians 44 31 70 4 o o 48 31 65 

Lawyers and judges 42 30 71 9 3 33 5i 33 65 

Teachers 3 2 67 195 141 7^ 198 143 72 

Entertainers and artists. .16 7 44 54 30 56 70 37 53 

Other professions 74 49 60 35 15 43 109 64 59 

Domestic and personal 4 ^ Sp 4 2 50 

Oerical 34 18 53 286 236 83 320 254 79 

No choice 4 o o 9 iii 13 i 8 

Total 495 305 62 607 430 71 1102 735 67 

In the total group the percentages do not vary widely 
among the groups which attract twenty or more children. 
The smaller number of cases in the less popular groups 
renders their percentages practically meaningless. In the case 
of the boys, permanency is pretty well equalized among the 
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groups. However, the girls present an entirely different 
situation. If we except those choosing clerical work and 
teaching, their average permanence is but 37J<. In this con- 
nection the following question is in order : What effect has 
one year had upon the delimitation of the girls' choices ? In 
December, 1922, 50^ of the girls made clerical choices and 
27J< selected teaching, leaving only 23^ for all other kinds of 
activity. In December, 1923, 49}^ made clerical choices and 
33fi selected teaching, leaving only i8{^ for other vocations. 
That is, as time goes on, girls' vocational choices tend to 
become more and more restricted. By combining the allied 
groups, we shall be able to see more clearly permanency 
variations. Here all six professional groups are united. Ag^- 
culture. Manufacturing, and Mechanical Industries are 
grouped under the last mentioned name. Domestic and Per- 
sonal Service, Public Service, and Transportation are classed 
as General Service. Trade and Qerical Services remain as 
before. 

TABLE 29 
Percentages of Permanency 

Boys Girb Total group 

8 .2*{ "St? 8 .5- oj 8 S*i ofr 
•a -s -sS &8 'S -Si &I 'S -al &» 

Professions 294 241 82 297 236 79 591 477 81 

Clerical 34 18 53 286 236 83 320 254 79 

Trade S3 32 60 7 o 60 32 53 

Mechanical industries ...loi 56 55 loi 56 55 

General service 9 6 67 8 4 50 17 10 59 

No choice 4 o o 9 iii 13 x 8 

Total 495 353 72 607 477 80 1102 830 75 

This table indicates that, in three cases out of four, a pupil 
will adhere, at least for a year, to his type of vocational choice. 

We may also study the several groups in respect to the 
grade of intelligence of the pupils that they attract. For this 
purpose the groups will be studied in two divisions, those 
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attfacting twenty or more pupfls and those drawing less than 
twenty. The figures are not given separately for the boys 
and girls here as there is no noticeable sex difference ap- 
parent. The median I. Q/s for the groups of both divisions 
follow. 

TABLE so 

A 
Ihtelligehce Levels or the Laker Gioups 

No. of Median 
Group cases I. Q. 

Physicians 39 lao^ 

Lawyers 52 iicm> 

Engineers 107 113.5 

Otner i^ofessions 122 113.3 

Entertainers and artists.... 62 112.3 

Teachers 207 110.2 

Trade 49 107.6 

Mechanical industries 79 106. i 

Qerical 342 100.8 

Total 1059 

B 

Intelugbncb Levels of the Smaller Gboups 

No. of Median 
Group cases I. Q. 

Agriculture 10 121 

Public service 9 116 

Domestic and personal 5 114 

Manufacturing i 98 

Transportation 7 93.5 

No choice 11 109 

Total 43 

Part B of this table is given just for conq>leteness. The 
small number of the cases makes the medians too unreliable 
to be worthy of any consideration. However, Table A gives 
results that are, to say the least, interesting. Those children 
making professional choices are definitely above the other 
groups mentally. The would-be physicians and lawyers seem 
to be head and shoulders above the others. Then, we find the 
three groups — engineers, other professions and entertainers 
and artists — closely bunched. Two points lower come those 
who wish to be teachers. Thus, all the groups representing 
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those who have professional aspirations represent those of 
intelligence superior to any non-professional group. Next 
come the future tradesmen and mechanics with I. Q/s but 
three or four points below those of the teachers. Finally, 
after a big gap, those with clerical aspirations bring up the 
rear. We may conclude that the pupils choosing those voca- 
tions that require lengthy and exacting school preparation 
are those who are most capable mentally. 



CHAPTER XIII 
The Reliabiuty of the Data Presented 

While the essential data of this study were secured through 
questionnaires, certain factors in the methods employed prac- 
tically overcome several of the pitfalls which are liable to 
beset the usual employment of the questionnaire method. For 
instance, no allowance need be made for any numerical inade- 
quacy of the portion of blanks returned because the original 
questionnaires were given to all the pupils in the /B classes 
who could be reached. Approximately gofi of the gross 
enrollment was reached by the first questionnaire. The ques- 
tionnaires were given in a regular school period. The pupils 
were given all the time they required to fill them out and 
teacher-examiners were present to explain any terms that 
the pupils did not understand. Therefore, we may feel 
reasonably certain that the import of the questionnaire was 
made dear to the pupils. 

Were the pupils competent to answer the questions and 
careful in so doing? A satisfactory answer can be given to 
this question. The essential part of the study is, of course, 
the vocational information secured. The pupil was given an 
uncontrolled choice in this matter; no vocations were sug- 
gested to him. He either had to think or to fail to answer 
the question. That he chose the former alternative is evident 
when we remember that g^ of the pupils r^stered choices. 
The vital question then becomes : Were these choices actually 
thought out, or were they a matter of chance? The results 
obtained from the follow-up questionnaires give a decided 
answer to this question. After a year, two-thirds of the 
pupils still cling to their original choices. This percentage 
(66.7}^) may be compared with those obtained from the three 
sets of controlled choices (Recreational Interests, Study 
Interests, and Work Interests) studied. These latter gave 
us permanency percentages ranging between 36^ and 40^. 
Hence, we may reasonably conclude that the pupils are much 
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more likely to stick to choices to the making of which 
they must give some thought, than they are to those which 
are the result of a selection of one out of a ntmiber of sug- 
gestions. Further, the percentage of permanency of voca- 
tional interests for the three periods is practically constant. 
The laws of chance do not so conduct themselves ; were the 
vocational interests expressed a matter of chance, we should 
expect a percentage ot permanency of from 7 to 10 per 
cent. Still further evidence may be adduced by comparing 
the entire vocational distributions of the several periods. 
The first and second distributions are 91.9)^ identical; the 
first and third, 89.5}^ ; and the first and fourth, 90.6^. There- 
fore, some sort of a law of compensation is at work ; while 
only two-thirds of the individuals retain their original 
choices, nine-tenths of the group remains constant. If the 
four distributions are each arranged so as to approximate as 
nearly as possible the probability distribution, there are no 
significant changes of position among the vocational groups. 
For example, clerical work is the most favored group all 
foiu* times, with a practically constant percentage of the 
cases. By a chance distribution, it is practically impossible 
that this could ever happen twice in succession, not to mention 
four times. 

We have seen^hat the permanency of the vocational choices 
for one year was 66.7;^. The reliability of the instrument 
(the questionnaire) is only one of the factors involved in the 
permanency of interests. The questionnaire is just as reliable 
when it shows a change where a change has actually taken 
place, as where it shows true permanence. Examination of 
the questionnaires of the pupils who change has led to the 
conclusion that a large number of the pupils who changed 
did so for good reasons. Some of the reasons were: new 
interests developed through studies and out-of-school activi- 
ties, weaknesses revealed through school failures, and altered 
financial circumstances. Hence, if we may express nunieri- 
cally the reliability of the data here secured by the ques- 
tionnaire, it is decidedly higher than 66.7;^. 
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Are the interests revealed by the questionnaire vital, 
practical ones? The best answer we may now secure for 
this question must be based upon our study of the courses 
which the pupils selected. The choice of a course, as 
stated previously, represents the most significant decision 
that a pupil is called upon to make during his junior high 
school career. The figures speak for themselves; more than 
92^ of the pupils selected that course which best fits their 
interests. These interests undoubtedly function in the every- 
day life of the pupils. 

There is one more question to consider : Can these inter- 
ests serve as a guide to capacity ? To secure evidence on this 
point the clerical pupils were selected both because they 
constituted the largest sub-group and because more data 
were available in their case than in that of any other group. 
It was demonstrated that those who displayed permanent 
clerical preferences markedly excelled the entire group in a 
test that purports to measure clerical ability. It was also 
shown that while their general intelligence was slightly 
inferior to that of the entire group, they achieved satis- 
factorily high marks in their three commercial school sub- 
jects. This problem requires much more extensive treat- 
ment, but the evidence so far produced indicates a positive 
relationship between interest and capacity. 



CHAPTER XIV 
Conclusions 

1. Intelligence ratings form an effective basis for grouping 
pupils so that their vocational preferences may be investigated 
from the viewpoint of vocational guidance. 

2. Vocational guidance, to be effective, must be commenced 
at the beginning of the junior high school period. 

3. The vocational interests of junior high school pupils 
show a very high degree of permanence over a period of at 
least one year — and that a critical one. Two children out of 
every three have the same preference at the end of the 
period as they had at the beginning. 

4. Vocational interests are more subject to change while 
the children are in school than while they are on vacation. 

5. The girls' choices are more permanent than the boys'. 
This difference is due to the greater restriction of occupa- 
tional opportunities for girls. However, as time goes on, 
the margin of difference is steadily decreased. 

6. Permanency is markedly higher when the choice is 
uncontrolled than when it is controlled. 

7. The gross distribution of vocational choices among the 
several occupational groups is practically constant for the 
four periods studied. 

8. In the junior high school, economic pressure is evidently 
not nearly so important a cause of pupil elimination as has 
been generally claimed. Two other factors — ^intelligence and 
interest — ^must be considered prepotent. The children whose 
mental capacity is below the average furnish twice as large 
a percentage of withdrawals as they should do if intelligence 
were a n^ligible factor. Children with non-professional 
interests are more than twice as likely to be eliminated as are 
those with professional interests. 

9. The vocational interests expressed by the pupils are 
vital and practical. They function almost perfectly in en- 
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abling the pupils to make the most important decision of their 
junior high school careers — ^the selection of their courses. 

10. The special study of the clerical pupils shows that the 
interests expressed are closely correlated with successful 
school work. 

11. The pupils who adhere to clerical interests make much 
higher scores on a prognostic clerical test than the larger, 
tmselected group, of which they are a part, although they 
are of lower general ability than the larger group. 

12. The relationship between the results secured from the 
I. £. R. Qerical test and success in clerical studies seems to 
grow closer as the pupils get further along in their studies. 

13. D^^ee of intelligence and degree of permanency are 
apparently unrelated. 

14. The pupils who wish to enter vocations that require 
a more or less lengthy and rigorous educational preparation 
have higher intelligence than those who decide otherwise. 

15. Among the girls the following relationships obtain: 
The lower the intelligence, the more likely one is to select 
clerical work; the higher the intelligence, the more likely 
one is to select teaching ; and, the higher the intelligence, the 
more likely one is to choose some vocation other than these 
two. 

16. The occupational field open to the average girl is much 
narrower than that open to the average boy. The girl's in- 
terests are also much more restricted. These facts must be 
taken into consideration in administering vocational guidance 
and vocational education. Our aim in vocational education 
should be to recognize the differences between boys and 
girls in interests and attitudes by dealing with them in 
different ways for the purpose of preserving such differences 
and fostering them. Vocational information courses for girls 
should be separate from those for boys. The two problems 
are entirely different. If the distribution of girls' choices 
were to be superimposed upon that of boys' choices, the per- 
centage of identity would be but 20^; that is, the interests 
of but one boy in five would be adequately considered in a 
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course designed to meet the needs and interests of girls, and 
vice versa. A compromise would not solve the problem ; the 
disparity is too great. A recognition of sex differences in 
respect to interests and opportunities must be the basis for 
the organization of effective vocational information courses 
and for guidance arising therefrom. 
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APPENDIX I 
Vocational Interests Questionnaike 

BojrorGirl Dite.. 



Age . 
What 



yrs. mos. Father's Occopatioo 

It school were yoa in a jrear ago, that ts» December, 1922? 

Ans, 

What grade were yon hi then? i^iix. 

What was the number of your class? Ans. 

L Ummsoon ths Couisb You aib TAKma 

Industrial Academic Commercial 

II. Vocational Piefesbncl 

Question i. What one occupation would you most of all like 
to go into, when jrou leave school? 

Ans, 

Question a. Wh^ do you want to go into this line of work? 

Give your mam reason. 
Ans. 

III. Recieational Interests. 

Question i. Which of the following kinds of entertainment 
would you prefer to attend? (Mark " i " 00 the line before 
your first dioice, "2" before ]rour second, and "3" before 
]rour third.) 

Automobile Show. 

Band Concert 

Boat Race. 

Bojdng Match. 

Circus. 

Dog Show. 

— — Food>all Game. 

Grand Opera. 

Illustrated Lecture. 

Moving Picture Exhibit 

Political Rally. 

Musical Comedy. 

IV. School Subjects I Like Best. 

Question i. Which of the following school subjects have 
most interested you? (Mark " i " on the line before the 
most interesting subject, "2" before the next and *'3'' 
before the third most interesting.) 

English. 

Arithmetic 

Geography. 

History. 

■ Science. 

Penmanship. 

Manual Training. 

Mechanical Drawing. 

Sewing. 

Cookery. 

Drawing. 

Music. 

Physical Training. 
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V. Work Intebests. 

Read through the followinp: list of kinds of activities care- 
fully. Select the three kmds of work at^ which you think 
you would do best, and at which you think you would be 
contented to work permanently. Place the figure " i " 
before that group which you would place first for yourself ; 
place "a" before your second choice; and "3 before 
your third choice. 

Kinds of Activities 

Growing plants, as in fanning, etc 

Care of animals, as in stock raising, etc. 

Operating engines, as locomotives, etc 

Operating machines, as in maufacturing, etc. 

Installing equipment, as electrician, etc 

Construction work, as in building, etc 

Delicate muscular movements, as dentist, etc 

Discovering and repairing defects, as jeweler, etc 

Transporting activities, as railroad operation, etc 

Meeting and directing people, as secretary, etc 

Teaching, as in school, shop, etc 

Welfare work, as in social settlements, etc 

Advisory service, as physician, lawyer, etc 

Organizmg people, as in societies, work gangs, etc 

Influencing people directly, selling, preaching, etc 

-^ Influencing people indirectly, as new^>aper work, 

etc 

Organized planning^, as in business, etc 

Scientific work, as m laboratories, etc 

Recording and systematizing records, as in office 

work, etc 

— Entertaining people, as musician, actor, etc 

Artistic skill, as in decorating, millinery, etc 

Artistic creation, as in writing, designing, etc 

— Field of activity not in this list and described as 

follows : 
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pages. 2 folders, $1.50), by Dr. Elmer Rhodes Hoke, Profes«ior of 
I'Mncation. Lebanon Valley (Tollege. 

No. 7. "The Improvement of Speed and Accuracy in Typewrit- 
ing" (42 pages. 75 cents), by Dr. Roy Edward Hoke, Professor of 
Education. Hirmingham-Southern College. 

No. 8. "The Permanence of the Vocational Interests of Junior 
Hiiih School Pupils" (72 pages. $1.15). hy .Dr. F-dward Earle 
I'niiiklin, Associate Professor of Education, Birmingham-Southern 
College. 

Orders may be placed with any bookseller or sent direct to 
the publisher. 
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